ayaanzhaque / instruct-nerf2nerf

Instruct-NeRF2NeRF: Editing 3D Scenes with Instructions (ICCV 2023)
https://instruct-nerf2nerf.github.io/
MIT License
769 stars 64 forks source link

How to convert "nerf_llff_data" data to your project? #63

Closed starcxl closed 8 months ago

starcxl commented 9 months ago

Hi, Ayaan, many thanks for your awesome work! It's really interesting!

May I ask how to process the data released by the "NeRF: Neural Radiance Fields" into your project? (The NeRF data link is here: https://drive.google.com/drive/folders/128yBriW1IG_3NJ5Rp7APSTZsJqdJdfc1)

I tried to process "nerf_llff_data/flower" by using the command below: ns-process-data images --data Data/flower --output-dir Data/flower --skip_colmap --colmap_model_path sparse/0 --skip_image_processing

and then using the command below to train the original NeRF: ns-train nerfacto --data Data/flower/ --max-num-iterations 90000 nerfstudio-data --downscale-factor 8

But the rendering image is very blurry as below, I don't know what causes this problem. Could you please tell me what's happening?

截屏2023-09-21 13 16 26
ayaanzhaque commented 9 months ago

This is an issue with nerfacto being designed to work well with unbounded scenes and not front-facing scenes. You can find some more information on this page.

hitachinsk commented 8 months ago

@starcxl Hello, did you solve this problem? I also adopted a front-facing scene to train nerfacto but I got the result just like yours.

ayaanzhaque commented 8 months ago

Will close this issue, I recommend asking this in the main nerfstudio repo