kerrj / lerf

Code for LERF: Language Embedded Radiance Fields
https://www.lerf.io/
MIT License
668 stars 65 forks source link

Obtain volume-rendered semantic field in at test time? #40

Closed benoriol closed 1 year ago

benoriol commented 1 year ago

Hello,

is there a way to obtain the per-image volume-rendered 2d feature fields during test time? Seems that outputs["clip"] = self.renderer_clip(...) outputs the per-ray feature which don't necessarily add up to a whole image right? Is there any part of the LERF codebase where I have access to the whole HxWxEmb_size tensor per each frame or do I need to dig into the NerfStudio code for this?

Thanks,

Benet