Forward-facing scene implementation

[dogyoonlee]

Hi, I appreciate to your awesome work!

I have three questions.

1. How to train NeuS on forward-facing scene(e.g. fern scene in NeRF dataset) using dataloader for llff formatted scene? I used dataloader in official implementation of NeRF to load the offered dataset from them. In their dataset,poses_bounded.npz, which is already colmap-preprocessed data, are exists and I used it. Hence, near and far bound are set following the npz file and they are not estimated as unit-sphere as you implemented for NeuS. In addition, we use the camera poses of the scene from poses_bounded.npz as it is and not rescale as you did in your code following original NeRF setting. Is there any problem for this setting to train the NeuS on real forward-facing scene? I wonder that we have to rescale the forward-facing scene to be in unit-sphere scale and rescale the camera pose for training NeuS.

2. How to set the object bounding box parameters(object_bbox_min, object_bbox_max in dataset.py) for forward-facing scene? I guess it would not necessary for forward-facing scene since they are scene-level NeRF framework and not object-centric scene. However, I'm confused how to set the above values to generate mesh from trained NeuS for forward-facing scene.

3. Related to question 2. Unlike the dataset used to train NeuS on this repo, forward-facing scene usually include sky-like part which are regarded as infinite depth. Hence I wonder it is necessary to use the NDC coordinate to train the NeuS on forward-facing scene. In addition, if it is necessary to set the object bounding box parameters to exclude the sky-like part when we generate mesh from trained NeuS on forward-facing scene, how to set the values?

Thank you for your work again and I will wait for your reply!

[rockywind]

I met the same problem in automous driving dataset, like Kitti! Any idea?

[yifanlu0227]

@rockywind Have you got some solutions?