Issue during preprocessing of Neural 3D Video dataset

[jayaramreddy10]

Hi, thanks for making the code public. I am getting below issue when running the preprocessing code on Neural 3D dataset (cook_spinach). Any idea what might be the issue here?

Command: python script/pre_n3d.py --videopath ../neural_3d_video_dataset/cook_spinach/ **Error message:

Undistorted image found; copying to location: ../neural_3d_video_dataset/cook_spinach/colmap_0/images/cam13.png PC: @ 0x7ff558e6f00b gsignal SIGABRT (@0x71b6b838003180d5) received by PID 3244245 (TID 0x7ff53f5ff000) from PID 3244245; stack trace: @ 0x7ff580de7631 (unknown) @ 0x7ff577939420 (unknown) @ 0x7ff558e6f00b gsignal @ 0x7ff558e4e859 abort @ 0x7ff5590bc8d1 (unknown) @ 0x7ff5590c837c (unknown) @ 0x7ff5590c83e7 std::terminate() @ 0x7ff5590c836f std::rethrow_exception() @ 0x55cfc263b79a colmap::COLMAPUndistorter::Run() @ 0x55cfc2808291 colmap::Thread::RunFunc() @ 0x7ff5590f4df4 (unknown) @ 0x7ff57792d609 start_thread @ 0x7ff558f4b133 clone Aborted (core dumped)**

Thanks

[lizhan17]

Hi, It seems to me that colmap failed. We can first check that colmap is installed under the python=3.8 environment by conda channel ?

[jayaramreddy10]

Yes, I have installed the conda env as per instructions . Its 3.8 .

(colmapenv) jayaram.reddy@super:~$ python Python 3.8.18 (default, Sep 11 2023, 13:40:15) [GCC 11.2.0] :: Anaconda, Inc. on linux Type "help", "copyright", "credits" or "license" for more information.

[lizhan17]

Yes, I have installed the conda env as per instructions . Its 3.8 .

(colmapenv) jayaram.reddy@super:~$ python

Python 3.8.18 (default, Sep 11 2023, 13:40:15)

[GCC 11.2.0] :: Anaconda, Inc. on linux

Type "help", "copyright", "credits" or "license" for more information.

Hi, for the input to the script, is this "../Neural3D/cook_spinach/" a relative path?

[jayaramreddy10]

I have given absolute path only, not the relative, didnt paste it here as it was very long. Won't it work with absolute path?

[lizhan17]

I have given absolute path only, not the relative, didnt paste it here as it was very long. Won't it work with absolute path?

It should work with absolute path. (Code is designed for absolute path.) Can your machine run the Gaussian-splatting's original colmap script? And could you mind providing your machine settings like gpu model, system version?

[jayaramreddy10]

Yes, it was able to run the Gaussian splatting repo colmap script. Below are the details:

System: Distributor ID: Pop Description: Pop!_OS 20.04 LTS Release: 20.04 Codename: focal

Machine:

I am using the GPU id 1 (rtx3060) from the server to run the pre_n3d.py script .. . I have also tried on GTX TITAN X in the same server, its giving the same issue.

Let me know if you need any other details. Thanks

[lizhan17]

Yes, it was able to run the Gaussian splatting repo colmap script. Below are the details:

System:

Distributor ID: Pop

Description: Pop!_OS 20.04 LTS

Release: 20.04

Codename: focal

Machine:

I am using the GPU id 1 (rtx3060) from the server to run the pre_n3d.py script .. . I have also tried on GTX TITAN X in the same server, its giving the same issue.

Let me know if you need any other details. Thanks

Hi, I am out for two days. I will check this on my machine at home with similar setting as yours two days later.

[jayaramreddy10]

Yes, it was able to run the Gaussian splatting repo colmap script. Below are the details: System: Distributor ID: Pop Description: Pop!_OS 20.04 LTS Release: 20.04 Codename: focal Machine: I am using the GPU id 1 (rtx3060) from the server to run the pre_n3d.py script .. . I have also tried on GTX TITAN X in the same server, its giving the same issue. Let me know if you need any other details. Thanks

Hi, I am out for two days. I will check this on my machine at home with similar setting as yours two days later.

To be precise , error is happening here and code is exiting. Paths are correct as expected, have verified it.

img_undist_cmd = "colmap" + " image_undistorter --image_path " + inputimagefolder + " --input_path " + distortedmodel  + " --output_path " + folder  \
+ " --output_type COLMAP" 
exit_code = os.system(img_undist_cmd)

[lizhan17]

Hi, do you have a precious crash before this step? Is the output folder empty before the function is called?

Another possible reason is https://github.com/colmap/colmap/issues/614 Possible solution is setting the cuda devices?

If other steps are correct(you have non zero points3D.bin file). the undistorted step and steps after it for n3d can be replaced by manually copying and moving the distorted models/images to target undistorted folder. The n3d images are already undistorted. Make sure that the new folder path and names consist with Gaussian-splatting's format of undistorted image and sparse model.

[jayaramreddy10]

Got it, will do the above. Thanks for the help. You can close the issue ...