search

NVlabs / nvdiffrast

Nvdiffrast - Modular Primitives for High-Performance Differentiable Rendering
Other
1.37k stars 146 forks source link

Points rasterizer #109

Closed gaobodaxinwen closed 1 year ago

gaobodaxinwen commented 1 year ago

Thanks for sharing this great work! It seems that egl is used for rasterization and meshes are required as input. I wonder if it would be possible to rasterize point clouds using nvdiffrast like https://github.com/facebookresearch/pytorch3d/blob/main/docs/tutorials/render_colored_points.ipynb.

s-laine commented 1 year ago

Nvdiffrast doesn't support rasterizing primitives other than triangle meshes. It would be possible to simulate point-based rendering by rasterizing multiple layers of camera-oriented billboards (one per point) using depth peeling, and blending the results together heuristically like the point-based renderers do. The performance might not be great, though.

gaobodaxinwen commented 1 year ago

Thanks for your advice! I will try it as you say.