carla-simulator / leaderboard

CARLA Autonomous Driving leaderboard
MIT License
164 stars 77 forks source link

How to convert scenarios in leaderboard 1.0 in the leaderboard 2.0 #159

Closed lsrrrrrrrrr closed 4 months ago

lsrrrrrrrrr commented 11 months ago

How to convert scenarios in leaderboard 1.0 in the leaderboard 2.0. The leaderboard 2.0 uses config file which combinates of scenarios and routes e.g. leaderboard/data/routes_validation.xml. However, the leaderboard 1.0 starts a scenario with the route config file and scenario config file in a seperate manner. The difficulty is these two types of scenario files are different. How to convert the 1.0 version to 2.0 veresion?

glopezdiest commented 5 months ago

There really isn't an easy way to do so right now, but it would actually be really useful to have. We might do that in the near future.

As a bit of context, the Leaderboard 1.0 has all the scenarios in a file, and only specific ones are selected based on this function. That is a convoluted and non-intuitive approach, hence why the Leaderboard 2.0 changed that to a more direct one, and loads all scenarios part of the xml.

glopezdiest commented 4 months ago

This ended up peaking my curiosity so the PR #178 adds a script that converts LB1 routes to LB2 ones