Drexubery / ViewCrafter

Official implementation of "ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesis"
Apache License 2.0
741 stars 24 forks source link

Can We generate a single novel view given rotation angles? #8

Open LaFeuilleMorte opened 2 weeks ago

LaFeuilleMorte commented 2 weeks ago

Hi, very impressive work! I learned that your model are capable of generating a sequence of images given an input view and camera trajactory. However what I expected is to generate a novel view at rotation angle B given an input view at angle A. This would save a lot of time as we don't need to generate intermediate frames. Could that be done finetuning this model? Thanks in advance for your reply!

Drexubery commented 2 weeks ago

Thanks! This seems like something ZeroNVS could handle, you can try their code https://github.com/kylesargent/ZeroNVS.