search

Harry-Zhi / semantic_nerf

The implementation of "In-Place Scene Labelling and Understanding with Implicit Scene Representation" [ICCV 2021].
Other
430 stars 55 forks source link

Mesh file #23

Closed tensarflow closed 1 year ago

tensarflow commented 2 years ago

Hi, i want to test semantic_nerf model, but is extract colour mesh file for testing. If it is, why neccessary mesh file, is nerf model need to generate mesh model. In conclusion, how can i do testing

Harry-Zhi commented 2 years ago

Hi @tensarflow
Sorry for the late reply due to recent DDL.

3D mesh reconstruction in extract_colour_mesh.py is used to extract an explicit 3D model out of neural fieds which is less intuitive to inspect by us what geometry has been learned within the MLP model. If you aim to test geometry quality, this may be related. But please note that there is several parameters which affects this process, such as the threshold of marching cubes, the near/far and camera positions during vertex label rendering.

As to quantitaitve evaluation in 2D image spaces, you could render novel images/depths/labels at certain view points and then use 2D metrics, which origial NeRF and this repo both do, e.g., depth metrics

Harry-Zhi commented 1 year ago

Close it for now. Feel free to re-open it if you have any further questions.