search

Thinklab-SJTU / Bench2Drive

[NeurIPS 2024 Datasets and Benchmarks Track] Closed-Loop E2E-AD Benchmark Enhanced by World Model RL Expert
Other
1.27k stars 83 forks source link

Ques about resume #89

Closed starlighttt123 closed 1 month ago

starlighttt123 commented 2 months ago

hello，thanks for your great work, but I'm currently facing some problems regarding the process of the resume even after having reviewed the relevant issues. My problem is that a process keep crashing after resume and since that I can't finish the whole eval process. Could you please explain in detail what is the whole process of resume? Are they:

  1. find the crash id and comment it in xml
  2. manually change the json file
  3. re-run run_evaluation_multi_vad.sh Does it miss some other operation? Thanks for your reply！
jayyoung0802 commented 2 months ago

For example, if you comment one route in xml, the total routes should be 16-1=15. image

Manually change the total routes 16-->15 image

Before re-run run_evaluation_multi_vad.sh, please check split_xml.py. It cannot be executed, otherwise the xml will be overwritten.

Maybe some crash routes are continuous in xml file and may cause trouble for you. Just comment them out.

And we publish our eval json in eval json, feel free to refer to it.