hustvl / 4DGaussians

[CVPR 2024] 4D Gaussian Splatting for Real-Time Dynamic Scene Rendering
https://guanjunwu.github.io/4dgs/
Apache License 2.0
2.25k stars 187 forks source link

Core dumped error when training on HyperNerf #189

Open KW-NJU opened 2 months ago

KW-NJU commented 2 months ago

Hi, when I was running:

# First, computing dense point clouds by COLMAP
bash colmap.sh data/hypernerf/virg/broom2 hypernerf``

I got:

 database.py:11: DeprecationWarning: tostring() is deprecated. Use tobytes() instead.
  return array.tostring()
database.py:17: DeprecationWarning: The binary mode of fromstring is deprecated, as it behaves surprisingly on unicode inputs. Use frombuffer instead
  return np.fromstring(blob, dtype=dtype).reshape(*shape)
1
0
Traceback (most recent call last):
  File "database.py", line 121, in <module>
    camTodatabase()
  File "database.py", line 111, in camTodatabase
    assert camera_id == idList[i]
AssertionError
I0915 23:56:56.158452 533658 misc.cc:198] 
==============================================================================
Feature matching
==============================================================================
I0915 23:56:56.159049 533659 sift.cc:1423] Creating SIFT GPU feature matcher
I0915 23:56:56.159130 533660 sift.cc:1423] Creating SIFT GPU feature matcher
I0915 23:56:56.159216 533661 sift.cc:1423] Creating SIFT GPU feature matcher
I0915 23:56:56.159302 533663 sift.cc:1423] Creating SIFT GPU feature matcher
I0915 23:56:56.793231 533658 pairing.cc:168] Generating exhaustive image pairs...
I0915 23:56:56.793285 533658 pairing.cc:201] Matching block [1/4, 1/4]
I0915 23:56:59.473655 533658 feature_matching.cc:46] in 2.680s
I0915 23:56:59.487838 533658 pairing.cc:201] Matching block [1/4, 2/4]
I0915 23:56:59.901249 533658 feature_matching.cc:46] in 0.413s
I0915 23:56:59.914366 533658 pairing.cc:201] Matching block [1/4, 3/4]
I0915 23:57:00.266264 533658 feature_matching.cc:46] in 0.352s
I0915 23:57:00.288311 533658 pairing.cc:201] Matching block [1/4, 4/4]
I0915 23:57:00.581876 533658 feature_matching.cc:46] in 0.294s
I0915 23:57:00.590309 533658 pairing.cc:201] Matching block [2/4, 1/4]
I0915 23:57:00.934144 533658 feature_matching.cc:46] in 0.344s
I0915 23:57:00.946676 533658 pairing.cc:201] Matching block [2/4, 2/4]
I0915 23:57:01.283676 533658 feature_matching.cc:46] in 0.337s
I0915 23:57:01.294663 533658 pairing.cc:201] Matching block [2/4, 3/4]
I0915 23:57:01.603541 533658 feature_matching.cc:46] in 0.309s
I0915 23:57:01.616276 533658 pairing.cc:201] Matching block [2/4, 4/4]
I0915 23:57:01.906965 533658 feature_matching.cc:46] in 0.291s
I0915 23:57:01.915755 533658 pairing.cc:201] Matching block [3/4, 1/4]
I0915 23:57:02.294349 533658 feature_matching.cc:46] in 0.379s
I0915 23:57:02.314045 533658 pairing.cc:201] Matching block [3/4, 2/4]
I0915 23:57:02.676772 533658 feature_matching.cc:46] in 0.363s
I0915 23:57:02.697229 533658 pairing.cc:201] Matching block [3/4, 3/4]
I0915 23:57:03.084242 533658 feature_matching.cc:46] in 0.387s
I0915 23:57:03.098366 533658 pairing.cc:201] Matching block [3/4, 4/4]
I0915 23:57:03.468775 533658 feature_matching.cc:46] in 0.370s
I0915 23:57:03.482347 533658 pairing.cc:201] Matching block [4/4, 1/4]
I0915 23:57:03.829955 533658 feature_matching.cc:46] in 0.348s
I0915 23:57:03.842114 533658 pairing.cc:201] Matching block [4/4, 2/4]
I0915 23:57:04.222658 533658 feature_matching.cc:46] in 0.381s
I0915 23:57:04.242852 533658 pairing.cc:201] Matching block [4/4, 3/4]
I0915 23:57:04.614725 533658 feature_matching.cc:46] in 0.372s
I0915 23:57:04.640851 533658 pairing.cc:201] Matching block [4/4, 4/4]
I0915 23:57:04.959960 533658 feature_matching.cc:46] in 0.319s
I0915 23:57:04.972088 533658 timer.cc:91] Elapsed time: 0.147 [minutes]
I0915 23:57:05.104589 533753 misc.cc:198] 
==============================================================================
Loading model
==============================================================================
I0915 23:57:05.108386 533753 incremental_mapper.cc:232] Loading database
I0915 23:57:05.109251 533753 database_cache.cc:65] Loading cameras...
I0915 23:57:05.109577 533753 database_cache.cc:75]  197 in 0.000s
I0915 23:57:05.109627 533753 database_cache.cc:83] Loading matches...
I0915 23:57:05.221618 533753 database_cache.cc:89]  14328 in 0.112s
I0915 23:57:05.221654 533753 database_cache.cc:105] Loading images...
I0915 23:57:05.248127 533753 database_cache.cc:155]  197 in 0.026s (connected 197)
I0915 23:57:05.248173 533753 database_cache.cc:166] Building correspondence graph...
I0915 23:57:06.269960 533753 database_cache.cc:195]  in 1.022s (ignored 0)
I0915 23:57:06.277172 533753 timer.cc:91] Elapsed time: 0.019 [minutes]
I0915 23:57:06.355268 533753 incremental_mapper.cc:550] Iterative triangulation
I0915 23:57:06.355293 533753 incremental_mapper.cc:556] Triangulating image #1 (0)
I0915 23:57:06.355301 533753 incremental_mapper.cc:558] => Image sees 0 / 2993 points
E0915 23:57:06.355317 533753 image.h:174] 'camera_ptr_' Must be non NULL
terminate called after throwing an instance of 'std::invalid_argument'
  what():  [image.h:174] 'camera_ptr_' Must be non NULL
*** Aborted at 1726415826 (unix time) try "date -d @1726415826" if you are using GNU date ***
PC: @     0x7fac49b4c00b gsignal
*** SIGABRT (@0x3ec000824f9) received by PID 533753 (TID 0x7fac425dc000) from PID 533753; stack trace: ***
    @     0x7fac4b355631 (unknown)
    @     0x7fac4b32c420 (unknown)
    @     0x7fac49b4c00b gsignal
    @     0x7fac49b2b859 abort
    @     0x7fac49f058d1 (unknown)
    @     0x7fac49f1137c (unknown)
    @     0x7fac49f113e7 std::terminate()
    @     0x7fac49f11699 __cxa_throw
    @     0x560f318f957e _ZN6colmap23IncrementalTriangulator16TriangulateImageERKNS0_7OptionsEj.cold
    @     0x560f31a8499f colmap::IncrementalMapper::TriangulateImage()
    @     0x560f31a149ad colmap::IncrementalPipeline::TriangulateReconstruction()
    @     0x560f319432ba colmap::RunPointTriangulatorImpl()
    @     0x560f31943861 colmap::RunPointTriangulator()
    @     0x560f3192446f main
    @     0x7fac49b2d083 __libc_start_main
    @     0x560f3192b5ee _start
colmap.sh: line 20: 533753 Aborted                 (core dumped) colmap point_triangulator --database_path $workdir/colmap/database.db --image_path $workdir/colmap/images --input_path $workdir/colmap/sparse_custom --output_path $workdir/colmap/sparse/0 --clear_points 1
I0915 23:57:06.521849 533812 misc.cc:198] 
==============================================================================
Reading reconstruction
==============================================================================
E0915 23:57:06.521922 533812 reconstruction.cc:547] cameras, images, points3D files do not exist at ../Dataset/HyperNerf/vrig/broom2/colmap/sparse/0
terminate called after throwing an instance of 'std::invalid_argument'
  what():  [reconstruction.cc:547] cameras, images, points3D files do not exist at ../Dataset/HyperNerf/vrig/broom2/colmap/sparse/0
*** Aborted at 1726415826 (unix time) try "date -d @1726415826" if you are using GNU date ***
PC: @     0x7fb231f7c00b gsignal
*** SIGABRT (@0x3ec00082534) received by PID 533812 (TID 0x7fb22aa0c000) from PID 533812; stack trace: ***
    @     0x7fb233785631 (unknown)
    @     0x7fb23375c420 (unknown)
    @     0x7fb231f7c00b gsignal
    @     0x7fb231f5b859 abort
    @     0x7fb2323358d1 (unknown)
    @     0x7fb23234137c (unknown)
    @     0x7fb2323413e7 std::terminate()
    @     0x7fb232341699 __cxa_throw
    @     0x56229f1cd33b _ZN6colmap14Reconstruction4ReadERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE.cold
    @     0x56229f23fe7b colmap::RunImageUndistorter()
    @     0x56229f1fd46f main
    @     0x7fb231f5d083 __libc_start_main
    @     0x56229f2045ee _start
colmap.sh: line 23: 533812 Aborted                 (core dumped) colmap image_undistorter --image_path $workdir/colmap/images --input_path $workdir/colmap/sparse/0 --output_path $workdir/colmap/dense/workspace
I0915 23:57:06.661424 533861 patch_match.cc:233] Reading workspace...
E0915 23:57:06.661628 533861 reconstruction.cc:547] cameras, images, points3D files do not exist at ../Dataset/HyperNerf/vrig/broom2/colmap/dense/workspace/sparse
terminate called after throwing an instance of 'std::invalid_argument'
  what():  [reconstruction.cc:547] cameras, images, points3D files do not exist at ../Dataset/HyperNerf/vrig/broom2/colmap/dense/workspace/sparse
*** Aborted at 1726415826 (unix time) try "date -d @1726415826" if you are using GNU date ***
PC: @     0x7f7cada0a00b gsignal
*** SIGABRT (@0x3ec00082565) received by PID 533861 (TID 0x7f7ca649a000) from PID 533861; stack trace: ***
    @     0x7f7caf213631 (unknown)
    @     0x7f7caf1ea420 (unknown)
    @     0x7f7cada0a00b gsignal
    @     0x7f7cad9e9859 abort
    @     0x7f7caddc38d1 (unknown)
    @     0x7f7caddcf37c (unknown)
    @     0x7f7caddcf3e7 std::terminate()
    @     0x7f7caddcf699 __cxa_throw
    @     0x5619993cd33b _ZN6colmap14Reconstruction4ReadERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE.cold
    @     0x56199971375b colmap::mvs::Model::ReadFromCOLMAP()
    @     0x5619997185eb colmap::mvs::Model::Read()
    @     0x56199971fc0e colmap::mvs::Workspace::Workspace()
    @     0x561999720e53 colmap::mvs::CachedWorkspace::CachedWorkspace()
    @     0x56199958ce4c colmap::mvs::PatchMatchController::ReadWorkspace()
    @     0x5619995924e0 colmap::mvs::PatchMatchController::Run()
    @     0x56199945b824 colmap::RunPatchMatchStereo()
    @     0x5619993fd46f main
    @     0x7f7cad9eb083 __libc_start_main
    @     0x5619994045ee _start
colmap.sh: line 24: 533861 Aborted                 (core dumped) colmap patch_match_stereo --workspace_path $workdir/colmap/dense/workspace
I0915 23:57:06.798388 533911 misc.cc:205] 
StereoFusion::Options
---------------------
I0915 23:57:06.798452 533911 fusion.cc:89] mask_path: 
I0915 23:57:06.798480 533911 fusion.cc:90] max_image_size: -1
I0915 23:57:06.798494 533911 fusion.cc:91] min_num_pixels: 5
I0915 23:57:06.798506 533911 fusion.cc:92] max_num_pixels: 10000
I0915 23:57:06.798518 533911 fusion.cc:93] max_traversal_depth: 100
I0915 23:57:06.798530 533911 fusion.cc:94] max_reproj_error: 2
I0915 23:57:06.798548 533911 fusion.cc:95] max_depth_error: 0.01
I0915 23:57:06.798561 533911 fusion.cc:96] max_normal_error: 10
I0915 23:57:06.798575 533911 fusion.cc:97] check_num_images: 50
I0915 23:57:06.798588 533911 fusion.cc:98] use_cache: 0
I0915 23:57:06.798600 533911 fusion.cc:99] cache_size: 32
I0915 23:57:06.798614 533911 fusion.cc:102] bbox_min: -3.40282e+38 -3.40282e+38 -3.40282e+38
I0915 23:57:06.798643 533911 fusion.cc:103] bbox_max: 3.40282e+38 3.40282e+38 3.40282e+38
I0915 23:57:06.798666 533911 fusion.cc:153] Reading workspace...
E0915 23:57:06.798707 533911 misc.cc:282] Check failed: (file).is_open() Could not open ../Dataset/HyperNerf/vrig/broom2/colmap/dense/workspace/stereo/fusion.cfg. Is the path a directory or does the parent dir not exist?
terminate called after throwing an instance of 'std::invalid_argument'
  what():  [misc.cc:282] Check failed: (file).is_open() Could not open ../Dataset/HyperNerf/vrig/broom2/colmap/dense/workspace/stereo/fusion.cfg. Is the path a directory or does the parent dir not exist?
*** Aborted at 1726415826 (unix time) try "date -d @1726415826" if you are using GNU date ***
PC: @     0x7fae2b15600b gsignal
*** SIGABRT (@0x3ec00082597) received by PID 533911 (TID 0x7fae23be6000) from PID 533911; stack trace: ***
    @     0x7fae2c95f631 (unknown)
    @     0x7fae2c936420 (unknown)
    @     0x7fae2b15600b gsignal
    @     0x7fae2b135859 abort
    @     0x7fae2b50f8d1 (unknown)
    @     0x7fae2b51b37c (unknown)
    @     0x7fae2b51b3e7 std::terminate()
    @     0x7fae2b51b699 __cxa_throw
    @     0x55677e8bb11e _ZN6colmap17ReadTextFileLinesERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE.cold
    @     0x55677ebaea0f colmap::mvs::StereoFusion::Run()
    @     0x55677e943520 colmap::RunStereoFuser()
    @     0x55677e8e446f main
    @     0x7fae2b137083 __libc_start_main
    @     0x55677e8eb5ee _start
colmap.sh: line 25: 533911 Aborted                 (core dumped) colmap stereo_fusion --workspace_path $workdir/colmap/dense/workspace --output_path $workdir/colmap/dense/workspace/fused.ply

What should I do?