google / mipnerf

Apache License 2.0
900 stars 110 forks source link

Extracting isosurfaces of Mip-NeRF #30

Open egorzakharov opened 2 years ago

egorzakharov commented 2 years ago

Hello!

Thanks for sharing this awesome work! :)

I'm curious, have you thought about the correct way of extracting the isosurfaces from the trained implicit function?

For vanilla NeRF model it is possible to extract the level surface at two scales using separately trained coarse and fine networks. Here, as far as I understand, it is possible to extract the level surface at an arbitrary scale, and for that I could just query the network with a positional encoding obtained for a desired point x and some manually selected variance, which determines the scale.

Does this approach makes sense to you, or are there some reasons why it could fail?

jonbarron commented 2 years ago

You can definitely query a mipnerf at any desired point x and covariance matrix Sigma. I'm not sure what this has to do with isosurfaces though.