search

Drexubery / ViewCrafter

Official implementation of "ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesis"
Apache License 2.0
881 stars 32 forks source link

question about 360° rendering. #19

Closed Vincento-Wang closed 1 month ago

Vincento-Wang commented 1 month ago

I have not seen any demo of 360 scene rendered results. the max number of generated frames is 16 ? and it can not cover 360° view range ？

Drexubery commented 1 month ago

Hi, the max number of generated frames is 25, and it can not cover 360° view range with only a single input view

Vincento-Wang commented 1 month ago

and it can not cover 360° view range with only a single input view

how many input views for 360° reconstruction? for example, if I set the 16 frames at every 20° viewpoint, the multi-view predicts will not to be continues, in this case, does it work ?

Yukun-Huang commented 1 month ago

I tried some 360° rendered results by modifying the trajectory. Iterative novel view synthesis might give better results.

https://github.com/user-attachments/assets/f2c77a53-4c3b-4229-ab32-fceb37cd7e56

https://github.com/user-attachments/assets/09725211-48eb-45aa-a2ae-468aeb7dacc8