search

ayaanzhaque / instruct-nerf2nerf

Instruct-NeRF2NeRF: Editing 3D Scenes with Instructions (ICCV 2023)
https://instruct-nerf2nerf.github.io/
MIT License
792 stars 70 forks source link

About the farm-small dataset #44

Closed jmchensc closed 1 year ago

jmchensc commented 1 year ago

Hi, thanks for your great work. I'm curious about how you deal with your farm-small dataset. It seems that it's an OPENCV_FISHEYE camera model. I want to use it in the origin NeRF. Actually, I use colmap and https://github.com/NVlabs/instant-ngp/blob/6ee7724370b5e7aa9d514a8c36fae78c112706d9/scripts/colmap2nerf.py to get a transforms.json file from the farm-small images you have provided. But I don't have experience to deal with fisheye dataset in NeRF. It seems that the get_ray function wrote by myself is wrong and I can't get the correct rendering result in NeRF. Or is there other things should be changed compared with the OPENCV camera model? Thanks for your patience.

ayaanzhaque commented 1 year ago

@tancik may have some better advice for you, but I don't think the original NeRF method works well for real-world and unbounded scenes like the farm scene. We recommend that you use Nerfacto as it is specifically suited for real-world scenes.

tancik commented 1 year ago

That is correct.