Anttwo / SuGaR

[CVPR 2024] Official PyTorch implementation of SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Rendering
https://anttwo.github.io/sugar/
Other
2.22k stars 166 forks source link

Interactive Viewers #21

Open cv-lab-x opened 10 months ago

cv-lab-x commented 10 months ago

thanks for your geat work, how to Interactive Viewers with SuGar model pt model ? Looking forward to your reply! @Anttwo

yuedajiong commented 10 months ago

same question, learning and resolving... (updating ...)

  1. what do you want to interact? a) the .pt is pytorch checkpoint. b) there are some SuGaR related data, such as points, colors, ... c) the points are binded_to_surface_mesh or not. 2) what is you wanted for view? mesh? if mesh, we need extract mesh periodically while training and show it in mesh render, or dump as multi-version and display it later. (extract_mesh.py extract_refined_mesh_with_texture.py) SuGaR points? (dump to .ply (bin or txt), show as point-cloud) Rendered?
cv-lab-x commented 10 months ago

same question, learning and resolving... (updating ...)

  1. what do you want to interact? a) the .pt is pytorch checkpoint. b) there are some SuGaR related data, such as points, colors, ... c) the points are binded_to_surface_mesh or not.

  2. what is you wanted for view? mesh? if mesh, we need extract mesh periodically while training and show it in mesh render, or dump as multi-version and display it later. (extract_mesh.py extract_refined_mesh_with_texture.py) SuGaR points? (dump to .ply (bin or txt), show as point-cloud) Rendered?

render with sugar points or hybrid render with mesh and binding sugar points