search

NVIDIAGameWorks / kaolin-wisp

NVIDIA Kaolin Wisp is a PyTorch library powered by NVIDIA Kaolin Core to work with neural fields (including NeRFs, NGLOD, instant-ngp and VQAD).
Other
1.45k stars 132 forks source link

Rasterization pipeline for interactive renderer #166

Closed orperel closed 11 months ago

orperel commented 11 months ago

Enables visualizing rasterized pipelines within the interactive renderer, i.e. rendered meshes. RasterizedRenderer is now patched to support rasterized objects within the scene graph. This MR does not support optimization of differentiable rasterizers (see kaolin DIB-R / nvdiffrast).

The usage of this MR is intended to be as follows:

from wisp.renderer.core.api import RasterizedRenderer, register_rasterizer
@register_rasterizer(YOUR_RASTERIZER_CLASS_HERE)
class YourWispSceneGraphNodeRenderer(RasterizedRenderer): 
     @torch.no_grad()
     def render(self, camera: Camera) -> RenderBuffer:
              ...