search

huawei-noah / SMARTS

Scalable Multi-Agent RL Training School for Autonomous Driving
MIT License
954 stars 190 forks source link

Path from start point to end point flows in the opposite direction of the generated route #2107

Closed n0xtua closed 1 year ago

n0xtua commented 1 year ago

High Level Description

I am using SMARTS to train a PPO Model (using sb3), and I have created a script that uses the benchmark metrics to evaluate my model every few thousand time steps of training. I am using functions from smarts/env/gymnasium/wrappers/metric/ to evaluate my trained model. I am facing the same error on multiple scenarios in sumo/intersection/

Version

v 1.1.0

Operating System

Ubuntu 18.04.6

Problems

After a few epochs of alternating training and evaluation, I face an error while one the evaluation loops is running.

n0xtua commented 1 year ago

Can someone please guide me on what could be the cause of this error?

Adaickalavan commented 1 year ago

Hi @n00b-c0dr,

  1. The error from _get_dist on line 570 in file SMARTS/smarts/env/gymnasium/wrappers/metric/costs.py appears to be from an older code version. Please use the latest code version from the master branch, as the Metrics has since been updated.

  2. To efficiently debug this, please provide a minimum working example to reproduce the error.

  3. In general, this type of error is thrown when distance computation on the underlying map file fails. The Metrics has been tested to work on all training scenarios listed in Driving SMARTS 2023.1 & 2023.2 and Driving SMARTS 2023.3.

  4. Please paste any error messages in text format, instead of image format, to help us easily search for the errors.

n0xtua commented 1 year ago

Thank you for your reply. Sorry for pasting the error screenshot, I'll keep in mind the correct format. We have been building our project using SMARTS v1.1.0 for a while now and it never gave that error until now. We prefer to stick to that version as it will require us to change our whole code if we change the SMARTS version. I will look into the points you mentioned and if required, I will reopen the issue for further help.