wenyuqing / panacea

[CVPR2024] Official Repository of Paper "Panacea: Panoramic and Controllable Video Generation for Autonomous Driving"
https://panacea-ad.github.io/
Apache License 2.0
197 stars 12 forks source link

how to finetune controlnet #4

Closed shliu0 closed 11 months ago

shliu0 commented 11 months ago

great work! I would like to know if controlnet is jointly finetuned along with two stages(image&video), or the finetuning order is image->video->controlnet?

wenyuqing commented 11 months ago

ControlNet is jointly fine-tuned along with two stages.