nerfstudio-project / nerfstudio

A collaboration friendly studio for NeRFs
https://docs.nerf.studio
Apache License 2.0
8.87k stars 1.18k forks source link

Export Gaussian Quality #3080

Open StevenssW opened 2 months ago

StevenssW commented 2 months ago

The rendering effect looks good in the NerfStudio viewer when I train with Gaussian in NerfStudio. However, when I export the .ply file and edit it using Super Splat, I find the rendering effect deteriorates. What could be the reason for this? nerfstudio: nerfstudio supersplat: supersplat

jb-ye commented 2 months ago

This is a known issue. The rendering pipeline of nerfstudio's cuda rasterizer is not exactly the same as many web viewer which uses webGL/webGPU shader implementation. There are several factors that contributes to the issue (e.g. different color clamping schema, ignoring SH high order components, etc.).

The plan I have in mind is to develop a web viewer compatible training of splafacto. This feature is WIP.

StevenssW commented 2 months ago

Thank you very much for your reply, looking forward to it

sumanttyagi commented 2 weeks ago

@jb-ye can you add any parameter ie,e tweak the surface value so that all viewer could support to show similar results

jb-ye commented 2 weeks ago

There is a parallel effort to build a nerfstudio compatible viser viewer: https://github.com/nerfstudio-project/viser/pull/110