ZHU-Zhiyu / NVS_Solver

Source code of paper "NVS-Solver: Video Diffusion Model as Zero-Shot Novel View Synthesizer"
189 stars 1 forks source link

Use image diffusion model for interpolation #7

Closed aejion closed 3 weeks ago

aejion commented 3 weeks ago

Hi! Great work!

I would like to know if it is possible for NVS-Solver to use an image diffusion model for interpolation. Additionally, could you explain why you chose to use a video diffusion model for interpolation?

mengyou2 commented 3 weeks ago

Hi, @aejion, thanks for your interest in our project. SVD can predict a continuous video from a given image, thus ensuring better consistency between different generated viewpoints. This is a capability that image diffusion models lack.

aejion commented 3 weeks ago

Thanks for your quick reply!