google / nerfies

This is the code for Deformable Neural Radiance Fields, a.k.a. Nerfies.
https://nerfies.github.io
Apache License 2.0
1.64k stars 221 forks source link

Questions about face processing section in Colab #2

Closed jiejie22997 closed 3 years ago

jiejie22997 commented 3 years ago

Hi, thanks for releasing the codes.

In Colab, process a video into a Nerfie dataset, it seems that the face processing section is optional. I skipped this section and ran compute scene information section. It gives errors, "name 'new_scene_manager' is not defined' ". 'new_scene_manager' is defined in face processing section. Is it necessary to run the face processing section or did I miss anything?

WeChat Image_20210204220139

Thank you!

keunhong commented 3 years ago

Hi, if you'd like to skip the face processing, run new_scene_manager = scene_manager and then you'll have to compute your own near/far values as well as the scene scale.

jiejie22997 commented 3 years ago

hi, thanks for your fast response. I still have some questions. What is near/far value, and how can I calculate these? Is it anywhere in the colmap data? thanks

keunhong commented 3 years ago

You can use the pointcloud from SfM and the camera positions to compute the near/far planes. Actually the Colab already does that, and it doesn't depend on the face stuff. You can also plot the scene and set the near/far plane by hand if it doesn't seem to be doing the right thing.

jiejie22997 commented 3 years ago

Thank you! I understand it.

kurtjcu commented 3 years ago

Hi @jiejie22997 did you find a suitable method for generating or extracting the scene.json without faces?

keunhong commented 3 years ago

Hi, I have made the face processing part completely optional by generating camera trajectories without the facial landmarks. Please let me know if you have issues. Thanks!