using AI generated animations to create 3D scenes with nerf

NVlabs / instant-ngp

Instant neural graphics primitives: lightning fast NeRF and more

https://nvlabs.github.io/instant-ngp

Other

15.89k stars 1.91k forks source link

using AI generated animations to create 3D scenes with nerf #789

Open polina-powers opened 2 years ago

polina-powers commented 2 years ago

tried to train nerf locally on custom disco diffusion video, everything goes well till the point when i get the .txt file with camera values. 4th camera value returns "Nan". i tried replacing it with 0, so it starts the rendering part, but the camera angle is not accurate because 0 isn't the actual value. i get that it's not a real camera, just trying to see if i can get the 3D scene from DiscoDiffusion animation. lemme know if you had similar issues and know how to resolve them. thnx

aradhyamathur commented 2 years ago

This seems to be a duplicate of #434. The problem seems to be arising from colmap2nerf.