search

Drexubery / ViewCrafter

Official implementation of "ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesis"
Apache License 2.0
881 stars 32 forks source link

Questions about training #1

Closed xizaoqu closed 2 months ago

xizaoqu commented 2 months ago

Hi, very nice work.

May I ask if you could release the training scripts on this model? Was this model based on some fundamental models (like videocrafter) ?

Thanks.

Drexubery commented 2 months ago

Thanks! The model is finetuned from DynamiCrafter https://github.com/Doubiiu/DynamiCrafter. We are currently refining the dataset creation and training scripts, you can also refer to their training code.

xizaoqu commented 2 months ago

Thanks! The model is finetuned from DynamiCrafter https://github.com/Doubiiu/DynamiCrafter. We are currently refining the dataset creation and training scripts, you can also refer to their training code.

Thanks!

xizaoqu commented 2 months ago

One more question. Regarding the structure, what is the main difference between ViewCrafter and DynamiCrafter? Since DynamiCrafter is already capable of doing interpolation

Drexubery commented 2 months ago

One more question. Regarding the structure, what is the main difference between ViewCrafter and DynamiCrafter? Since DynamiCrafter is already capable of doing interpolation

ViewCrafter accepts single/sparse view as input, and enables user specifying the camera trajectory in the novel view synthesis/video generation process. It is not limited on interpolation. In comparison, the generation process of DynamiCrafter is not controllable. You can refer to our paper for more details and try our/their demo for a detailed comparison.

xizaoqu commented 2 months ago

Thanks for your explanation.

sudonymously commented 1 month ago

Hi! Really been loving the potential of this project. will you release the dataset creation and training code?

Drexubery commented 1 month ago

Yes, it's on our schedule.

sudo @.***>于2024年9月28日 周六02:04写道：

Hi! Really been loving the potential of this project. will you release the dataset creation and training code?

— Reply to this email directly, view it on GitHub https://github.com/Drexubery/ViewCrafter/issues/1#issuecomment-2379801759, or unsubscribe https://github.com/notifications/unsubscribe-auth/A3EPUZYDILO2QAYUJ4MDSC3ZYWM4JAVCNFSM6AAAAABNTVUQZWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGNZZHAYDCNZVHE . You are receiving this because you commented.Message ID: @.***>