search

stanfordnmbl / osim-rl

Reinforcement learning environments with musculoskeletal models
http://osim-rl.stanford.edu/
MIT License
894 stars 249 forks source link

Valid submit didn't register on the leaderboard at all (and videos are incorrect) #84

Closed AdamStelmaszczyk closed 6 years ago

AdamStelmaszczyk commented 7 years ago

I just had a submit of 22.71 (with version 1.5) which didn't register on the leaderboard (my current top is still 17.51).

[2017-10-13 23:28:58,385] POST http://grader.crowdai.org:1729/v1/envs/1245___6a384c7852/reset/
null
[2017-10-13 23:28:58,512] POST http://grader.crowdai.org:1729/v1/envs/1245___6a384c7852/monitor/close/
null
Your total reward from this submission: 22.710314
[2017-10-13 23:28:59,083] POST http://grader.crowdai.org:1729/v1/envs/1245___6a384c7852/close/
null
Steps: [1000, 1000, 1000]
Returns: [22.888436545155482, 22.740330392048087, 22.502173622908554]

real    35m47,856s
user    0m17,440s
sys     0m4,588s

Also, the video generated for the 17.51 submit is incorrect, skeleton falls immediately.

kidzik commented 7 years ago

@spMohanty do you know what might be the reason of this?