autonomousvision / plant

[CoRL'22] PlanT: Explainable Planning Transformers via Object-Level Representations
https://katrinrenz.de/plant/
MIT License
224 stars 30 forks source link

Questions about training data #2

Closed hrz2000 closed 1 year ago

hrz2000 commented 1 year ago

image

  1. Whether the files in the red box are the files that generate the training set of plantT

  2. What is the meaning of the "routes_training.xml" below the red box? It seems that the number of routes is only 50, but it has more waypoints per route. Is it a collection of files in the red box above?

  3. Are lav and longest6 used only as validation sets? Because I noticed that the number of their routes is very small

  4. the data_agent_boxes.py encapsulated autopilot experts conducted simulation tests and found that the results were very poor. The simulation would hit the wall soon after the start of the simulation, while the transferuser experts were normal. Have you noticed this problem?

Maybe my question will be a little silly. I'm a beginner and I look forward to your early reply.

RenzKa commented 1 year ago

Hi, thanks for your interest in our work.

  1. Yes we used the routes in the red box to generate our training set. You can check out the datagen.sh file to get the combinations of scenario files and route files (route file is the path after "eval.route_rel" and scenario file is the path after "eval.scenarios_rel"). You can also check out the transfuser repo for more information about the dataset.

  2. I removed them as they are not relevant to this work.

  3. We only used the longest 6 routes for online evaluation in our paper. For more information on this benchmark (e.g. number of routes etc. check out the transfuser paper and repo). I included LAV as another benchmark in case someone wants to run our model on the LAV routes.

  4. Can you tell me with which command you started your simulation test? Then I can look into it.

Best, Katrin

hrz2000 commented 1 year ago

Thank you for your prompt reply. I just noticed that planT's warehouse has been updated. The newly added code is very useful to us. ~For my fourth question above, I investigated again, and found that I ignored the DATAGEN parameter when changing the agent, which led to the instantiation of the self.agent_instance is actually a planT without loading parameters.~ Sorry, I need to correct it. My statement in the strikethrough is wrong, not because of the DATAGEN parameter, but because in the autopilot.py file of an earlier version of this github code repository, from carla_agent_files.nav_planner import PIDController, RoutePlanner, interpolate_trajectory in fact, it should be, from carla_agent_files.nav_planner import RoutePlanner_new as RoutePlanner as in the current version of the code. Thank you for your warm and detailed answers again!