crowdAI / crowdai

Fighting for Open Science with Open Data
https://www.crowdai.org
GNU Affero General Public License v3.0
149 stars 32 forks source link

Submission reset message #268

Closed scarroll32 closed 7 years ago

scarroll32 commented 7 years ago

Onr participant writes on the opensnp challenge discussion forum that :

CrowdAIExecuteFunctionError: {"message":"The participant has no submission slots remaining for today.","submission_id":null}
This leads me to believe that there is a submission limit of 5 per day (this should be mentioned explicitly on the overview page). However when I tried to make a submission on the next day (both from my local time and GMT) I still got the same error. I would like to know the time when the number of entries resets.
 7.screen shot 2017 02 22 at 12.48.51

(edited)

This is the error returned by the crowdAI API, which the grader simply relays to the participant so I am not sure, when exactly the 5 submissions per day limit resets

scarroll32 commented 7 years ago

The submissions are based on a rolling 24 hour period. We would need to calculate when a slot becomes available (when the first submission has aged out).

  def set_submissions_remaining
      submissions_today = Submission.where("participant_id = ? and created_at >= ?", current_participant.id, Time.now - 24.hours).count
      @submissions_remaining = (@challenge.daily_submissions - submissions_today)
    end

https://github.com/crowdAI/crowdai/blob/master/app/controllers/submissions_controller.rb#L119-L120

scarroll32 commented 7 years ago
scarroll32 commented 7 years ago

Will be handled in #327 refactoring

scarroll32 commented 7 years ago

Incorporated into #327