lgsvl / simulator

A ROS/ROS2 Multi-robot Simulator for Autonomous Vehicles
Other
2.29k stars 781 forks source link

What are Visual Scenario Editor test results 'success' criteria? #1426

Open krtt opened 3 years ago

krtt commented 3 years ago

I run SVL VSE with Borregas map, Lincoln car and keyboard control but the test results status seem to be wrong. What is the criteria exactly, based on what the test results are marked as 'success' and when 'failed' and when 'error'? Also, are there any log files (besides player.log) that give more information?

Examples:

The car did not reach the final destination point but stopped in the half way but the result is 'success':

image

EricBoiseLGSVL commented 3 years ago

Sensors have event criteria for simulation success. If you need different criteria, you can create a new sensor or edit and existing one to send a fail/success event. There is one other event that is in simulator source and that is the collision event.