OpenDriveLab / Vista

[NeurIPS 2024] A Generalizable World Model for Autonomous Driving
https://opendrivelab.com/Vista
Apache License 2.0
555 stars 41 forks source link

a question about action control on new scenes. #34

Open WuZhongQing opened 1 month ago

WuZhongQing commented 1 month ago

hi,i'm trying to control the direction of the car, and i used the command like this (and used image not in nuScene):

image

in the same time, i changed the code in "sampe.py",like:

image

but it doesn't work, the output of video doesn't change anything. cloud you please explain that ~ And i think the reason is all of your traing data has only one direction when traing phase 2 , is that a reasonable explaination ?^_^

WuZhongQing commented 1 month ago

and i had tried control the direction by using traj, it worked ~

Little-Podi commented 1 month ago

Thanks for your question! As mentioned in the appendix, the chance of failure persists in action control. Our model has better controllability for trajectory, angle, and speed conditions but is slightly worse for command and goal point conditions. The reason could be the limited diversity among training samples, as you said. To enable successful command control, I recommend trying a scenario where the ego vehicle arrives in front of a crossroad (or a place where turning can occur).