search

AIcrowd / real_robots

Gym environments for Robots that learn to interact with the environment autonomously
https://www.aicrowd.com/challenges/neurips-2019-robot-open-ended-autonomous-learning
MIT License
34 stars 18 forks source link

Detailed scores for goals #17

Closed emilio-cartoni closed 5 years ago

emilio-cartoni commented 5 years ago

In the current evaluation function, there is no way for the user to know which goals succeeded and which goals failed. The individual score for a single goal is neither displayed nor returned. Can the evaluation function return the scores variable as well (maybe renamed as detailed_scores) or would it break something? (I am thinking about people testing locally, not suggesting to display this detailed score online).

spMohanty commented 5 years ago

Can you push a fix which demonstrates the capturing of the status of each of the goals ?

We will not be rendering it on the realtime evaluation feedback as it would be too much information, but we can very well show that on local evaluation.

emilio-cartoni commented 5 years ago

Done, and updated README.md. If it's okay for you we can close this :)