search

NVlabs / OmniDrive

225 stars 11 forks source link

Open-loop planning #7

Open fcjian opened 3 months ago

fcjian commented 3 months ago

Great work!!!

How to evaluate the results of the open-loop planning?

exiawsh commented 3 months ago

still cleaning the code. Will open source tomorrow.

exiawsh commented 3 months ago

Hi, please check. https://github.com/NVlabs/OmniDrive/blob/1912d53e66c3b42dac20021bb93957a01af212bb/docs/training_inference..md

fcjian commented 3 months ago

Thank you. I have another question. For the experiment in Table 5 of the paper, how can high-level commands be integrated into OmniDrive? And how can Ego Status be incorporated into OmniDrive for both BEV and Planner?

image
exiawsh commented 3 months ago

Planner:can_bus_mlp to encode ego_pose token and send it to LLM BEV: temporal modeling for streampetr.

Mr-Fu620 commented 1 week ago

How to add BEV to the model? According to the paper seem added MLP, but the BEV is so long?