search

Drexubery / ViewCrafter

Official implementation of "ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesis"
Apache License 2.0
881 stars 32 forks source link

using camera 4*4 matrix from dust3r instead of theta, phi, r #16

Open saetlan opened 1 month ago

saetlan commented 1 month ago

hey! Thanks for this great work 👏 I was wondering if there was already an easy way to use another view of the same scene to create the animation from one to the other.

I thought about using the pair with dust3r to get the relative camera 4*4 matrix but didn't find an existing way to use this to get the trajectory.

Is this something that could be easily done with what is already in the repo?

Kudos for the release !

Steven-Xiong commented 1 month ago

I have the similar issue. Is it possible to resist free camera movement in xyz space, like doing translation, instead of just moving around the center of the scene? Thank you.

Drexubery commented 1 month ago

Thanks for your interest! I guess you want to interpolate a trajectory between two or more views of a scene, which is exactly what our sparse view scripts can accomplish. We will release this code soon.

Steven-Xiong commented 4 weeks ago

Thank you. Would you have an estimated time to release this part of code?

Drexubery commented 4 weeks ago

Thank you. Would you have an estimated time to release this part of code?

Hi, I will try to release it next week