Code Monkey home page Code Monkey logo

crowdai's Introduction

CrowdAI Logo

crowdAI - The open platform for data science challenges

Code Climate Gitter chat View performance data on Skylight View performance data on Skylight View performance data on Skylight View performance data on Skylight

Introduction

crowdAI (www.crowdAI.org) is a not-for-profit platform for open data challenges. It has two goals:

  • to be the place for solving (big) data problems in open science through open challenges
  • to be the place for learning about the techniques used to solve these problems.

Developed by scientists and engineers at EPFL in Switzerland, crowdAI is open to participants from anywhere in the world. The platform is also open to host challenges from anyone else, from big or small research groups in academia to well established company dealing with an interesting problem around open science and open data.

Open data challenges on the web give everyone around the world a shot at tackling difficult data problems.
By providing their solutions openly, participants can rapidly learn the latest powerful techniques from each other.

Contributing to CrowdAI

๐Ÿ‘๐ŸŽ‰ First off, thanks for taking the time to contribute! ๐ŸŽ‰๐Ÿ‘ Did we you say you are Awesomeee ?

Our Contribution guidelines are available at CONTRIBUTING.md

Documentation

We are in the process of migrating our documentation from the Wiki into this repository as markdown files.

Contact

You can always reach out to us at [email protected] and you are always welcome to join the CrowdAI Community banter on our Gitter channel at https://gitter.im/crowdAI/Lobby

crowdai's People

Contributors

adrienpoly avatar balakirevs avatar bkdj avatar englhardt avatar harry-chen avatar ieggel avatar jonasrauber avatar mridulnagpal avatar scarroll32 avatar spmohanty avatar wastr avatar yannis avatar zgore14 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

crowdai's Issues

Memory paging in crowdAI

Feb 19 19:17:24 crowdai-prd heroku/web.2:  source=web.2 dyno=heroku.48624194.5ca0da63-a538-4ec4-aa69-2725f19c15da sample#memory_total=597.35MB sample#memory_rss=592.55MB sample#memory_cache=4.04MB sample#memory_swap=0.76MB sample#memory_pgpgin=404239pages sample#memory_pgpgout=251512pages sample#memory_quota=1024.00MB 
Feb 19 19:17:43 crowdai-prd heroku/web.2:  source=web.2 dyno=heroku.48624194.5ca0da63-a538-4ec4-aa69-2725f19c15da sample#load_avg_1m=0.00 sample#load_avg_5m=0.00 sample#load_avg_15m=0.00 
Feb 19 19:17:43 crowdai-prd heroku/web.2:  source=web.2 dyno=heroku.48624194.5ca0da63-a538-4ec4-aa69-2725f19c15da sample#memory_total=597.35MB sample#memory_rss=592.55MB sample#memory_cache=4.04MB sample#memory_swap=0.76MB sample#memory_pgpgin=404239pages sample#memory_pgpgout=251512pages sample#memory_quota=1024.00MB 
Feb 19 19:18:03 crowdai-prd heroku/web.2:  source=web.2 dyno=heroku.48624194.5ca0da63-a538-4ec4-aa69-2725f19c15da sample#load_avg_1m=0.00 sample#load_avg_5m=0.00 sample#load_avg_15m=0.00 
Feb 19 19:18:03 crowdai-prd heroku/web.2:  source=web.2 dyno=heroku.48624194.5ca0da63-a538-4ec4-aa69-2725f19c15da sample#memory_total=597.35MB sample#memory_rss=592.55MB sample#memory_cache=4.04MB sample#memory_swap=0.76MB sample#memory_pgpgin=404239pages sample#memory_pgpgout=251512pages sample#memory_quota=1024.00MB 
Feb 19 19:18:23 crowdai-prd heroku/web.2:  source=web.2 dyno=heroku.48624194.5ca0da63-a538-4ec4-aa69-2725f19c15da sample#load_avg_1m=0.00 sample#load_avg_5m=0.00 sample#load_avg_15m=0.00 
Feb 19 19:18:23 crowdai-prd heroku/web.2:  source=web.2 dyno=heroku.48624194.5ca0da63-a538-4ec4-aa69-2725f19c15da sample#memory_total=597.35MB sample#memory_rss=592.55MB sample#memory_cache=4.04MB sample#memory_swap=0.76MB sample#memory_pgpgin=404239pages sample#memory_pgpgout=251512pages sample#memory_quota=1024.00MB 
Feb 19 19:18:43 crowdai-prd heroku/web.2:  source=web.2 dyno=heroku.48624194.5ca0da63-a538-4ec4-aa69-2725f19c15da sample#load_avg_1m=0.00 sample#load_avg_5m=0.00 sample#load_avg_15m=0.00 
Feb 19 19:18:43 crowdai-prd heroku/web.2:  source=web.2 dyno=heroku.48624194.5ca0da63-a538-4ec4-aa69-2725f19c15da sample#memory_total=597.35MB sample#memory_rss=592.55MB sample#memory_cache=4.04MB sample#memory_swap=0.76MB sample#memory_pgpgin=404239pages sample#memory_pgpgout=251512pages sample#memory_quota=1024.00MB 
Feb 19 19:19:03 crowdai-prd heroku/web.2:  source=web.2 dyno=heroku.48624194.5ca0da63-a538-4ec4-aa69-2725f19c15da sample#load_avg_1m=0.00 sample#load_avg_5m=0.00 sample#load_avg_15m=0.00 
Feb 19 19:19:03 crowdai-prd heroku/web.2:  source=web.2 dyno=heroku.48624194.5ca0da63-a538-4ec4-aa69-2725f19c15da sample#memory_total=597.35MB sample#memory_rss=592.55MB sample#memory_cache=4.04MB sample#memory_swap=0.76MB sample#memory_pgpgin=404239pages sample#memory_pgpgout=251512pages sample#memory_quota=1024.00MB 

Change tracking navigation

Change tracking has been implemented by #257 and there is a count displayed to admins only.

screen shot 2016-08-25 at 14 52 56

Enhancements to this functionality are:

  • forward and back links to navigate through versions
  • which account made the change
  • highlight which fields were changed and mouse over for previous field versions
  • click to revert to a previous version (assumes all future versions would be deleted)

Unsubscribe email

  • token based
  • expire after 7 days
  • take user to a unsubscribe page but they are not actually logged in

Container file injection rules

Some file injection rules for containers have configuration fields, but are not implemented in the container builds. These need to be implemented at some point:

  • Grading only
  • Overwritable
  • Datasets directory

screen shot 2016-09-16 at 16 14 24

Depreciation warnings

Various deprecations to be updated before upgrading to Rails 5.1

DEPRECATION WARNING: `config.serve_static_files` is deprecated and will be removed in Rails 5.1.
2017-03-06T15:08:36.736467+00:00 app[worker.1]: Please use `config.public_file_server.enabled = true` instead.
DEPRECATION WARNING: `:nothing` option is deprecated and will be removed in Rails 5.1. Use `head` method to respond with empty response body. 
Mar 06 06:46:37 crowdai-prd app/web.2:  DEPRECATION WARNING: Passing an argument to force an association to reload is now deprecated and will be removed in Rails 5.1. Please call `reload` on the result collection proxy instead. (called from new at /app/app/controllers/posts_controller.rb:9) 
Mar 06 05:49:05 crowdai-prd app/worker.1:  DEPRECATION WARNING: alias_method_chain is deprecated. Please, use Module#prepend instead. From module, you can access the original method using super. (called from included at /app/vendor/bundle/ruby/2.3.0/bundler/gems/activeadmin-xls-a5a70018c626/lib/active_admin/xls/resource_controller_extension.rb:6) 
Mar 06 05:49:05 crowdai-prd app/worker.1:  DEPRECATION WARNING: In Rails 5.1, The `:subdomains` option of HSTS config will be treated as true if 
Mar 06 05:49:05 crowdai-prd app/worker.2:  DEPRECATION WARNING: `skip_filter` is deprecated and will be removed in Rails 5.1. Use skip_before_action, skip_after_action or skip_around_action instead. (called from <class:BaseController> at /app/app/controllers/api/base_controller.rb:4) 
Mar 06 05:49:05 crowdai-prd app/worker.2:  DEPRECATION WARNING: `skip_action_callback` is deprecated and will be removed in Rails 5.1. Please use skip_before_action, skip_after_action or skip_around_action instead. (called from <class:BaseController> at /app/app/controllers/api/base_controller.rb:4) 
Mar 06 05:49:05 crowdai-prd app/worker.2:  DEPRECATION WARNING: before_filter is deprecated and will be removed in Rails 5.1. Use before_action instead. (called from <class:BaseController> at /app/app/controllers/api/base_controller.rb:5) 

SSL Errors

I get SSL error message on both crowdAI.org and openfood.ch

screen shot 2017-02-24 at 8 55 06 pm

Automatically end challenges

Challenges are currently manually ended by an administrator.

Implement a background process or on-page trigger that automatically ends challenges when the end datetime has been reached.

Challenges sorting

Challenges should be sorted with the news on top (sort by start date) - at the moment the new challenges are at the bottom of the list:

screen shot 2017-02-26 at 4 03 20 pm

Host account cannot access show method

Re message received about a host account

I've logged into the Host account but when I press "crowdAI" in the navigation I get the following error message: NoMethodError in Organizers#show

End of challenge

  • challenge should be ending automatically (not working)
  • send an email to all participants that a new challenge has started and a challenge has ended (but we can still accept submissions).

crowdAI in classroom functionality

  • simplify timeline (move it into challenges)
  • follow general in-place editing model of the tutorials
  • move all header fields + status into header section
  • add private challenge checkbox to header section
  • create a new admin level for profs
  • admin only features marked consistently with an icon in collapsable areas
  • number and name of downloaders visible to admin directly on downloads page
  • downloads license editable directly on downloads page
  • evaluation rules embedded into challenge edit of evaluation view
  • hide docker configuration completely for now
  • cohort admin only view: allows invitation of participants to private challenges and also shows activity summary: downloads, submissions, forum posts. Build as partials and reuse on participant home page
  • add view as participant / view as admin (edit) toggle for admins

Automated triggering of grading upon submission

I think it would really be convenient for participants if the grading of their submission is automatically triggered upon submission. Given how much work goes into a particular submission, its a pain to wait for a manual trigger :'(

Ant Challenge: Submission Error messages

There have been two instances where there has been a problem with the submission file, and the error message is 'ant_id'.

What does this error message mean ... can we provide some more detail to participants?

screen shot 2016-11-26 at 07 23 19

CrowdAI emails not ending up in Primary inbox on Gmail

In my case, they end up in the "Promotions" section, while I do get a lot of emails which are actually promotions but they still end up in my Primary Inbox.
Would be a pity if people dont even get to notice our newletters, especially when its so low volume.

The submission made emails, and the forum notifications do end up in my primary inbox though.

User active indicator based on websockets

Currently the user 'Online now' indicator is based on a DB update, and causes many additional SQLs. This is inefficient when the site is scaled.

This should be replaced by an ActionCable solution

Dependent on #4

screen shot 2016-10-31 at 10 29 36

Buttons on the forums don't seem to have the proper classes

As you can see in this image, the buttons are not visually distinguishable from the rest of the text in the forum posts.
I think it should look more like the red button (that I created by simply modifying the markup to add btn btn-primary as classes) to make it more intuitive to use.
screen shot 2016-11-07 at 1 22 16 am

Update Landing page

Create a new engaging landing page for crowdAI

Potentially three boxes:

  • about crowdAI
  • box for participants
  • box for hosts

CI Issues

Tests that are passing locally fail on the CI.

/home/travis/.rvm/rubies/ruby-2.3.1/bin/ruby -I/home/travis/build/crowdAI/crowdai/vendor/bundle/ruby/2.3.0/gems/rspec-core-3.5.4/lib:/home/travis/build/crowdAI/crowdai/vendor/bundle/ruby/2.3.0/gems/rspec-support-3.5.0/lib /home/travis/build/crowdAI/crowdai/vendor/bundle/ruby/2.3.0/gems/rspec-core-3.5.4/exe/rspec --pattern spec/\*\*\{,/\*/\*\*\}/\*_spec.rb
Coverage report generated for RSpec to /home/travis/build/crowdAI/crowdai/coverage. 659 / 1016 LOC (64.86%) covered.
/home/travis/build/crowdAI/crowdai/app/models/dataset_file_download.rb:8:in `<class:DatasetFileDownload>': uninitialized constant DatasetFileDownload::Resolv (NameError)
	from /home/travis/build/crowdAI/crowdai/app/models/dataset_file_download.rb:1:in `<top (required)>'
	from /home/travis/build/crowdAI/crowdai/vendor/bundle/ruby/2.3.0/gems/activesupport-5.0.0.1/lib/active_support/dependencies/interlock.rb:12:in `block in loading'

Strange, as the code is it failing on is part of the Ruby standard lib

  validates :ip_address,
            presence: true,
            uniqueness: false,
            format: { with: Regexp.union(Resolv::IPv4::Regex, Resolv::IPv6::Regex) }

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.