Farama-Foundation / D4RL-Evaluations

Apache License 2.0
187 stars 27 forks source link

Evaluation on Carla #7

Open yanlai00 opened 4 years ago

yanlai00 commented 4 years ago

What is the correct way of doing evaluations on the Carla tasks? For example, when I run python awr/scripts/run_conv.py, it gives me an enormous number of warnings and NaNs also appear in the results (as in the image below), is that normal?

Screen Shot 2020-08-05 at 11 12 40 PM

Also, after 78 iterations the program is halted with "terminate called after throwing an instance of 'std::out_of_range'"

Thank you for making this great dataset! Would be better if more detailed instruction on how to replicate the results in the paper can be provided (even better if along with the estimated time when running on a single gpu)