nerfstudio-project / nerfstudio

A collaboration friendly studio for NeRFs
https://docs.nerf.studio
Apache License 2.0
8.87k stars 1.18k forks source link

Splat quality decrease after upgrading to gsplat 1.0.0 #3230

Closed rowellz closed 1 week ago

rowellz commented 2 weeks ago

Splat quality significantly decreases after upgrading nerfstudio & gplat. I am using nerfstudio in a docker container based off of the nerfstuido/nerfstudio image after I ran into problems using the dromni/nerfstudio image a few months back.

Steps to reproduce the behavior: Upgrade nerfstudio & gplat with pip install -U nerfstudio Process images with ns-process-data images Process Splat with ns-train splatfacto Observe splat model in viewer. The statue is not recognizable

Expected behavior The statue should be easily noticeable after loading the splat model

Statue splat before upgrading gsplat & nerfstudio

Screenshot 2024-06-14 at 2 15 21 PM

Statue splat after upgrading gsplat & nerfstudio

Screenshot 2024-06-14 at 2 16 00 PM

Both of these splats used the same source video, which can be viewed when clicking on the "Download Original Video" button in the splat viewer, which is at https://ez3d.nyc.

Thanks again to all the folks at nerfstudio for all of your awesome work. Please let me know if there is any more information I might need to provide to help resolve this issue.

maturk commented 2 weeks ago

What torch version are you using? There are problems with Torch 2.0.1. If so, you could upgrade to 2.1.2.

rowellz commented 1 week ago

You absolute genius! I was indeed on Torch 2.0.1. After running pip install -U torch==2.1.2 it worked! Training did seem to be a bit faster, but tough to notice due to colmap still :/ That said, what was most impressive was that the splat took up half the disk space than the one produced from the previous nerfstudio version. Literally went from 5.4 MB to 2.7 MB which is so huge when trying to render these splats on the client. Congrats on the awesome work, I am looking forward to regenerating all of my splats now, lol

maturk commented 1 week ago

Closing this one for the related issue #3235