PJLab-ADG / DriveArena

DriveArena: A Closed-loop Generative Simulation Platform for Autonomous Driving
https://pjlab-adg.github.io/DriveArena/
Apache License 2.0
218 stars 15 forks source link

Video Autoregression Dreamer #14

Open DevinCheung opened 1 week ago

DevinCheung commented 1 week ago

Thanks for your awesome work! May I ask when the video-version world dreamer would be released? Thanks!

DevinCheung commented 1 week ago

And the pretrained model "SDv1.5_mv_single_ref_nus" is only for multi-view image generation, not multi-view video generation? Thanks!

jokester-zzz commented 1 day ago

Thank you for your recognition.

"SDv1.5_mv_single_ref_nus" is a single-frame implementation of the autoregressive generation algorithm, it does has limitations in preserving temporal consistency. We are actively working on a more continuous version and have already achieved some promising results. For more details, you can refer to our report. We may also consider open-sourcing this part of the code in the future.