search

yanivw12 / gs2mesh

[ECCV 2024] Official implementation of the paper "GS2Mesh: Surface Reconstruction from Gaussian Splatting via Novel Stereo Views"
123 stars 6 forks source link

Error:mesh has 0 vertices #12

Open KaedeGo opened 2 weeks ago

KaedeGo commented 2 weeks ago

This is a great work！ but when I finally output the results, it shows [Open3D DEBUG] [ClusterConnectedTriangles] Compute triangle adjacency [Open3D DEBUG] [ClusterConnectedTriangles] Done computing triangle adjacency [Open3D DEBUG] [ClusterConnectedTriangles] Done clustering, #clusters=0 [Open3D WARNING] Write PLY failed: mesh has 0 vertices. SAVED CLEANED MESH I can't see any results in meshlab, what's the reason?

TXSevenXT commented 2 weeks ago

Hello KaedeGo,

Are you able to send previous code lines ? I've got this kind of error when COLMAP didn't get enough views

yanivw12 commented 2 weeks ago

As @TXSevenXT mentioned, I'd need to see the entire output of the script to identify where the issue is. There can be many reasons why the resulting mesh is empty, most of them can be solved quite easily.

RyanbowZ commented 1 week ago

Also faced this issue, here's the complete output log: Feature matching

==============================================================================
I1011 15:32:24.544263 209985 sift.cc:1426] Creating SIFT GPU feature matcher
I1011 15:32:24.604774 209984 pairing.cc:168] Generating exhaustive image pairs...
I1011 15:32:24.604795 209984 pairing.cc:201] Matching block [1/2, 1/2]
I1011 15:32:25.643347 209984 feature_matching.cc:46] in 1.039s
I1011 15:32:25.870755 209984 pairing.cc:201] Matching block [1/2, 2/2]
I1011 15:32:27.302678 209984 feature_matching.cc:46] in 1.432s
I1011 15:32:27.348088 209984 pairing.cc:201] Matching block [2/2, 1/2]
I1011 15:32:29.480974 209984 feature_matching.cc:46] in 2.133s
I1011 15:32:29.771986 209984 pairing.cc:201] Matching block [2/2, 2/2]
I1011 15:32:31.073016 209984 feature_matching.cc:46] in 1.301s
I1011 15:32:31.520663 209984 timer.cc:91] Elapsed time: 0.116 [minutes]
I1011 15:32:31.593978 210020 incremental_mapper.cc:237] Loading database
I1011 15:32:31.616053 210020 database_cache.cc:66] Loading cameras...
I1011 15:32:31.616946 210020 database_cache.cc:76]  1 in 0.001s
I1011 15:32:31.616966 210020 database_cache.cc:84] Loading matches...
I1011 15:32:31.731047 210020 database_cache.cc:90]  3745 in 0.114s
I1011 15:32:31.731077 210020 database_cache.cc:106] Loading images...
I1011 15:32:31.893880 210020 database_cache.cc:156]  99 in 0.163s (connected 99)
I1011 15:32:31.893920 210020 database_cache.cc:167] Loading pose priors...
I1011 15:32:31.903262 210020 database_cache.cc:178]  0 in 0.009s
I1011 15:32:31.903280 210020 database_cache.cc:187] Building correspondence graph...
I1011 15:32:31.957479 210020 database_cache.cc:216]  in 0.054s (ignored 0)
I1011 15:32:31.957787 210020 timer.cc:91] Elapsed time: 0.006 [minutes]
I1011 15:32:31.964461 210020 incremental_mapper.cc:282] Finding good initial image pair
I1011 15:32:31.976115 210020 incremental_mapper.cc:306] Initializing with image pair #44 and #42
I1011 15:32:31.979044 210020 incremental_mapper.cc:311] Global bundle adjustment
I1011 15:32:32.216141 210020 incremental_mapper.cc:390] Registering image #43 (3)
I1011 15:32:32.216172 210020 incremental_mapper.cc:393] => Image sees 749 / 2179 points
I1011 15:32:32.216300 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.216313 210020 incremental_mapper.cc:390] Registering image #41 (3)
I1011 15:32:32.216317 210020 incremental_mapper.cc:393] => Image sees 721 / 3740 points
I1011 15:32:32.216540 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.216559 210020 incremental_mapper.cc:390] Registering image #46 (3)
I1011 15:32:32.216588 210020 incremental_mapper.cc:393] => Image sees 654 / 3240 points
I1011 15:32:32.216917 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.216931 210020 incremental_mapper.cc:390] Registering image #45 (3)
I1011 15:32:32.216934 210020 incremental_mapper.cc:393] => Image sees 567 / 1958 points
I1011 15:32:32.217048 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.217125 210020 incremental_mapper.cc:390] Registering image #47 (3)
I1011 15:32:32.217130 210020 incremental_mapper.cc:393] => Image sees 576 / 3099 points
I1011 15:32:32.217283 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.217300 210020 incremental_mapper.cc:390] Registering image #40 (3)
I1011 15:32:32.217304 210020 incremental_mapper.cc:393] => Image sees 595 / 3644 points
I1011 15:32:32.217486 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.217499 210020 incremental_mapper.cc:390] Registering image #48 (3)
I1011 15:32:32.217500 210020 incremental_mapper.cc:393] => Image sees 532 / 3002 points
I1011 15:32:32.217612 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.217621 210020 incremental_mapper.cc:390] Registering image #39 (3)
I1011 15:32:32.217623 210020 incremental_mapper.cc:393] => Image sees 515 / 3864 points
I1011 15:32:32.217774 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.217783 210020 incremental_mapper.cc:390] Registering image #49 (3)
I1011 15:32:32.217785 210020 incremental_mapper.cc:393] => Image sees 374 / 1858 points
I1011 15:32:32.217855 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.217864 210020 incremental_mapper.cc:390] Registering image #50 (3)
I1011 15:32:32.217865 210020 incremental_mapper.cc:393] => Image sees 352 / 1882 points
I1011 15:32:32.217947 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.217954 210020 incremental_mapper.cc:390] Registering image #51 (3)
I1011 15:32:32.217990 210020 incremental_mapper.cc:393] => Image sees 391 / 2848 points
I1011 15:32:32.218120 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.218132 210020 incremental_mapper.cc:390] Registering image #38 (3)
I1011 15:32:32.218133 210020 incremental_mapper.cc:393] => Image sees 390 / 3757 points
I1011 15:32:32.218259 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.218266 210020 incremental_mapper.cc:390] Registering image #52 (3)
I1011 15:32:32.218268 210020 incremental_mapper.cc:393] => Image sees 364 / 2916 points
I1011 15:32:32.218369 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.218376 210020 incremental_mapper.cc:390] Registering image #53 (3)
I1011 15:32:32.218377 210020 incremental_mapper.cc:393] => Image sees 352 / 2959 points
I1011 15:32:32.218478 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.218487 210020 incremental_mapper.cc:390] Registering image #37 (3)
I1011 15:32:32.218488 210020 incremental_mapper.cc:393] => Image sees 322 / 3326 points
I1011 15:32:32.218595 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.218602 210020 incremental_mapper.cc:390] Registering image #54 (3)
I1011 15:32:32.218604 210020 incremental_mapper.cc:393] => Image sees 304 / 2897 points
I1011 15:32:32.218706 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.218714 210020 incremental_mapper.cc:390] Registering image #36 (3)
I1011 15:32:32.218716 210020 incremental_mapper.cc:393] => Image sees 279 / 3513 points
I1011 15:32:32.218837 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.218844 210020 incremental_mapper.cc:390] Registering image #35 (3)
I1011 15:32:32.218847 210020 incremental_mapper.cc:393] => Image sees 213 / 3283 points
I1011 15:32:32.218947 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.218955 210020 incremental_mapper.cc:390] Registering image #56 (3)
I1011 15:32:32.218957 210020 incremental_mapper.cc:393] => Image sees 202 / 3074 points
I1011 15:32:32.219066 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.219074 210020 incremental_mapper.cc:390] Registering image #55 (3)
I1011 15:32:32.219076 210020 incremental_mapper.cc:393] => Image sees 200 / 2681 points
I1011 15:32:32.219166 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.219173 210020 incremental_mapper.cc:390] Registering image #34 (3)
I1011 15:32:32.219175 210020 incremental_mapper.cc:393] => Image sees 186 / 3036 points
I1011 15:32:32.219270 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.219278 210020 incremental_mapper.cc:390] Registering image #58 (3)
I1011 15:32:32.219280 210020 incremental_mapper.cc:393] => Image sees 166 / 3320 points
I1011 15:32:32.219380 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.219388 210020 incremental_mapper.cc:390] Registering image #57 (3)
I1011 15:32:32.219390 210020 incremental_mapper.cc:393] => Image sees 170 / 3240 points
I1011 15:32:32.219489 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.219497 210020 incremental_mapper.cc:390] Registering image #33 (3)
I1011 15:32:32.219499 210020 incremental_mapper.cc:393] => Image sees 166 / 2995 points
I1011 15:32:32.219592 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.219600 210020 incremental_mapper.cc:390] Registering image #32 (3)
I1011 15:32:32.219602 210020 incremental_mapper.cc:393] => Image sees 166 / 3177 points
I1011 15:32:32.219703 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.219712 210020 incremental_mapper.cc:390] Registering image #60 (3)
I1011 15:32:32.219713 210020 incremental_mapper.cc:393] => Image sees 132 / 3414 points
I1011 15:32:32.219817 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.219825 210020 incremental_mapper.cc:390] Registering image #59 (3)
I1011 15:32:32.219827 210020 incremental_mapper.cc:393] => Image sees 127 / 2278 points
I1011 15:32:32.219997 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.220017 210020 incremental_mapper.cc:390] Registering image #31 (3)
I1011 15:32:32.220065 210020 incremental_mapper.cc:393] => Image sees 113 / 2964 points
I1011 15:32:32.220191 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.220202 210020 incremental_mapper.cc:390] Registering image #29 (3)
I1011 15:32:32.220204 210020 incremental_mapper.cc:393] => Image sees 106 / 3102 points
I1011 15:32:32.220310 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.220319 210020 incremental_mapper.cc:390] Registering image #30 (3)
I1011 15:32:32.220321 210020 incremental_mapper.cc:393] => Image sees 110 / 3281 points
I1011 15:32:32.220422 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.220429 210020 incremental_mapper.cc:390] Registering image #61 (3)
I1011 15:32:32.220431 210020 incremental_mapper.cc:393] => Image sees 94 / 3592 points
I1011 15:32:32.220544 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.220553 210020 incremental_mapper.cc:42] Retriangulation and Global bundle adjustment
I1011 15:32:32.454140 210020 incremental_mapper.cc:390] Registering image #62 (3)
I1011 15:32:32.454169 210020 incremental_mapper.cc:393] => Image sees 88 / 3632 points
I1011 15:32:32.454286 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.454296 210020 incremental_mapper.cc:390] Registering image #63 (3)
I1011 15:32:32.454298 210020 incremental_mapper.cc:393] => Image sees 79 / 3720 points
I1011 15:32:32.454409 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.454418 210020 incremental_mapper.cc:390] Registering image #64 (3)
I1011 15:32:32.454421 210020 incremental_mapper.cc:393] => Image sees 78 / 3512 points
I1011 15:32:32.454535 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.454545 210020 incremental_mapper.cc:390] Registering image #28 (3)
I1011 15:32:32.454546 210020 incremental_mapper.cc:393] => Image sees 62 / 1543 points
I1011 15:32:32.454603 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.454622 210020 incremental_mapper.cc:390] Registering image #25 (3)
I1011 15:32:32.454623 210020 incremental_mapper.cc:393] => Image sees 59 / 2349 points
I1011 15:32:32.454722 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.454730 210020 incremental_mapper.cc:390] Registering image #27 (3)
I1011 15:32:32.454732 210020 incremental_mapper.cc:393] => Image sees 62 / 2519 points
I1011 15:32:32.454811 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.454819 210020 incremental_mapper.cc:390] Registering image #65 (3)
I1011 15:32:32.454821 210020 incremental_mapper.cc:393] => Image sees 55 / 3587 points
I1011 15:32:32.454928 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.454936 210020 incremental_mapper.cc:390] Registering image #23 (3)
I1011 15:32:32.454938 210020 incremental_mapper.cc:393] => Image sees 54 / 2208 points
I1011 15:32:32.455008 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.455014 210020 incremental_mapper.cc:390] Registering image #66 (3)
I1011 15:32:32.455016 210020 incremental_mapper.cc:393] => Image sees 46 / 3770 points
I1011 15:32:32.455147 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.455155 210020 incremental_mapper.cc:390] Registering image #22 (3)
I1011 15:32:32.455159 210020 incremental_mapper.cc:393] => Image sees 44 / 2158 points
I1011 15:32:32.455224 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.455232 210020 incremental_mapper.cc:390] Registering image #26 (3)
I1011 15:32:32.455233 210020 incremental_mapper.cc:393] => Image sees 38 / 1383 points
I1011 15:32:32.455276 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.455284 210020 incremental_mapper.cc:390] Registering image #67 (3)
I1011 15:32:32.455286 210020 incremental_mapper.cc:393] => Image sees 39 / 3690 points
I1011 15:32:32.455410 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.455420 210020 incremental_mapper.cc:390] Registering image #8 (3)
I1011 15:32:32.455421 210020 incremental_mapper.cc:393] => Image sees 32 / 1845 points
I1011 15:32:32.455489 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.455497 210020 incremental_mapper.cc:390] Registering image #21 (3)
I1011 15:32:32.455499 210020 incremental_mapper.cc:393] => Image sees 31 / 1945 points
I1011 15:32:32.455557 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.455565 210020 incremental_mapper.cc:390] Registering image #74 (3)
I1011 15:32:32.455567 210020 incremental_mapper.cc:393] => Image sees 31 / 3483 points
I1011 15:32:32.455663 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.455672 210020 incremental_mapper.cc:390] Registering image #24 (3)
I1011 15:32:32.455673 210020 incremental_mapper.cc:393] => Image sees 30 / 1282 points
I1011 15:32:32.455716 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.455724 210020 incremental_mapper.cc:390] Registering image #43 (3)
I1011 15:32:32.455726 210020 incremental_mapper.cc:393] => Image sees 749 / 2179 points
I1011 15:32:32.455843 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.455852 210020 incremental_mapper.cc:390] Registering image #41 (3)
I1011 15:32:32.455853 210020 incremental_mapper.cc:393] => Image sees 721 / 3740 points
I1011 15:32:32.455998 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.456007 210020 incremental_mapper.cc:390] Registering image #46 (3)
I1011 15:32:32.456009 210020 incremental_mapper.cc:393] => Image sees 654 / 3240 points
I1011 15:32:32.456136 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.456146 210020 incremental_mapper.cc:390] Registering image #45 (3)
I1011 15:32:32.456146 210020 incremental_mapper.cc:393] => Image sees 567 / 1958 points
I1011 15:32:32.456235 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.456243 210020 incremental_mapper.cc:390] Registering image #47 (3)
I1011 15:32:32.456245 210020 incremental_mapper.cc:393] => Image sees 576 / 3099 points
I1011 15:32:32.456367 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.456374 210020 incremental_mapper.cc:390] Registering image #40 (3)
I1011 15:32:32.456377 210020 incremental_mapper.cc:393] => Image sees 595 / 3644 points
I1011 15:32:32.456506 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.456513 210020 incremental_mapper.cc:390] Registering image #48 (3)
I1011 15:32:32.456516 210020 incremental_mapper.cc:393] => Image sees 532 / 3002 points
I1011 15:32:32.456635 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.456773 210020 incremental_mapper.cc:390] Registering image #39 (3)
I1011 15:32:32.456782 210020 incremental_mapper.cc:393] => Image sees 515 / 3864 points
I1011 15:32:32.456946 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.456960 210020 incremental_mapper.cc:390] Registering image #49 (3)
I1011 15:32:32.456971 210020 incremental_mapper.cc:393] => Image sees 374 / 1858 points
I1011 15:32:32.457093 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.457101 210020 incremental_mapper.cc:390] Registering image #50 (3)
I1011 15:32:32.457103 210020 incremental_mapper.cc:393] => Image sees 352 / 1882 points
I1011 15:32:32.457190 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.457198 210020 incremental_mapper.cc:390] Registering image #51 (3)
I1011 15:32:32.457199 210020 incremental_mapper.cc:393] => Image sees 391 / 2848 points
I1011 15:32:32.457298 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.457306 210020 incremental_mapper.cc:390] Registering image #38 (3)
I1011 15:32:32.457307 210020 incremental_mapper.cc:393] => Image sees 390 / 3757 points
I1011 15:32:32.457440 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.457448 210020 incremental_mapper.cc:390] Registering image #52 (3)
I1011 15:32:32.457450 210020 incremental_mapper.cc:393] => Image sees 364 / 2916 points
I1011 15:32:32.457551 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.457559 210020 incremental_mapper.cc:390] Registering image #53 (3)
I1011 15:32:32.457561 210020 incremental_mapper.cc:393] => Image sees 352 / 2959 points
I1011 15:32:32.457661 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.457669 210020 incremental_mapper.cc:390] Registering image #37 (3)
I1011 15:32:32.457671 210020 incremental_mapper.cc:393] => Image sees 322 / 3326 points
I1011 15:32:32.457779 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.469709 210020 timer.cc:91] Elapsed time: 0.015 [minutes]
I1011 15:32:32.536317 210022 misc.cc:44] 
==============================================================================
Reading reconstruction
==============================================================================
I1011 15:32:32.544337 210022 image.cc:347] => Reconstruction with 2 images and 1363 points
I1011 15:32:32.544355 210022 misc.cc:44]
==============================================================================
Image undistortion
==============================================================================
I1011 15:32:32.554471 210022 undistortion.cc:215] Undistorting image [1/2]
I1011 15:32:32.610159 210022 undistortion.cc:215] Undistorting image [2/2]
I1011 15:32:32.610181 210022 undistortion.cc:225] Writing reconstruction...
I1011 15:32:32.620537 210022 undistortion.cc:230] Writing configuration...
I1011 15:32:32.623773 210022 undistortion.cc:234] Writing scripts...
I1011 15:32:32.627941 210022 timer.cc:91] Elapsed time: 0.001 [minutes]
Optimizing /mnt/d/rotate_chair
Output folder: /mnt/d/rotate_chair [11/10 15:32:33]
Reading camera 2/2 [11/10 15:32:33]
Converting point3d.bin to .ply, will happen only the first time you open the scene. [11/10 15:32:33]
Loading Training Cameras [11/10 15:32:33]
Loading Test Cameras [11/10 15:32:34]
Number of points at initialisation :  1363 [11/10 15:32:34]
Training progress:  23%|████████████████████▌                                                                   | 7000/30000 [00:54<02:51, 133.99it/s, Loss=0.0065778]
[ITER 7000] Evaluating train: L1 0.004105021618306637 PSNR 44.20554962158204 [11/10 15:33:30]

[ITER 7000] Saving Gaussians [11/10 15:33:30]
Training progress: 100%|███████████████████████████████████████████████████████████████████████████████████████| 30000/30000 [03:24<00:00, 146.86it/s, Loss=0.0032433]

[ITER 30000] Evaluating train: L1 0.0022015979047864676 PSNR 49.12659454345703 [11/10 15:35:59]

[ITER 30000] Saving Gaussians [11/10 15:35:59]

Training complete. [11/10 15:35:59]
num views: 2
baseline: 0.35000000303186307
Loading trained model at iteration 30000
Reading camera 2/2
Loading Training Cameras
Loading Test Cameras
  0%|                                                                                                                                           | 0/2 [00:00<?, ?it/s]
UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3609.)
UserWarning: Default grid_sample and affine_grid behavior has changed to align_corners=False since 1.3.0. Please specify align_corners=True if the old behavior is desired. See the documentation of grid_sample for details.
100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:01<00:00,  1.38it/s]
Automask must be enabled for masking in script mode. Skipping.
100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:00<00:00, 33.08it/s][Open3D WARNING] Write PLY failed: mesh has 0 vertices.
SAVED MESH
[Open3D DEBUG] [ClusterConnectedTriangles] Compute triangle adjacency
[Open3D DEBUG] [ClusterConnectedTriangles] Done computing triangle adjacency
[Open3D DEBUG] [ClusterConnectedTriangles] Done clustering, #clusters=0
[Open3D WARNING] Write PLY failed: mesh has 0 vertices.
RyanbowZ commented 1 week ago

@yanivw12 This is for custom data. I saw in your repository README, it says when reconstructing using custom data (image only, without COLMAP), it only requires image as inputs? Do we need to contain camera info or other files? How are the formats of them?

yanivw12 commented 6 days ago

Also faced this issue, here's the complete output log: Feature matching

==============================================================================
I1011 15:32:24.544263 209985 sift.cc:1426] Creating SIFT GPU feature matcher
I1011 15:32:24.604774 209984 pairing.cc:168] Generating exhaustive image pairs...
I1011 15:32:24.604795 209984 pairing.cc:201] Matching block [1/2, 1/2]
I1011 15:32:25.643347 209984 feature_matching.cc:46] in 1.039s
I1011 15:32:25.870755 209984 pairing.cc:201] Matching block [1/2, 2/2]
I1011 15:32:27.302678 209984 feature_matching.cc:46] in 1.432s
I1011 15:32:27.348088 209984 pairing.cc:201] Matching block [2/2, 1/2]
I1011 15:32:29.480974 209984 feature_matching.cc:46] in 2.133s
I1011 15:32:29.771986 209984 pairing.cc:201] Matching block [2/2, 2/2]
I1011 15:32:31.073016 209984 feature_matching.cc:46] in 1.301s
I1011 15:32:31.520663 209984 timer.cc:91] Elapsed time: 0.116 [minutes]
I1011 15:32:31.593978 210020 incremental_mapper.cc:237] Loading database
I1011 15:32:31.616053 210020 database_cache.cc:66] Loading cameras...
I1011 15:32:31.616946 210020 database_cache.cc:76]  1 in 0.001s
I1011 15:32:31.616966 210020 database_cache.cc:84] Loading matches...
I1011 15:32:31.731047 210020 database_cache.cc:90]  3745 in 0.114s
I1011 15:32:31.731077 210020 database_cache.cc:106] Loading images...
I1011 15:32:31.893880 210020 database_cache.cc:156]  99 in 0.163s (connected 99)
I1011 15:32:31.893920 210020 database_cache.cc:167] Loading pose priors...
I1011 15:32:31.903262 210020 database_cache.cc:178]  0 in 0.009s
I1011 15:32:31.903280 210020 database_cache.cc:187] Building correspondence graph...
I1011 15:32:31.957479 210020 database_cache.cc:216]  in 0.054s (ignored 0)
I1011 15:32:31.957787 210020 timer.cc:91] Elapsed time: 0.006 [minutes]
I1011 15:32:31.964461 210020 incremental_mapper.cc:282] Finding good initial image pair
I1011 15:32:31.976115 210020 incremental_mapper.cc:306] Initializing with image pair #44 and #42
I1011 15:32:31.979044 210020 incremental_mapper.cc:311] Global bundle adjustment
I1011 15:32:32.216141 210020 incremental_mapper.cc:390] Registering image #43 (3)
I1011 15:32:32.216172 210020 incremental_mapper.cc:393] => Image sees 749 / 2179 points
I1011 15:32:32.216300 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.216313 210020 incremental_mapper.cc:390] Registering image #41 (3)
I1011 15:32:32.216317 210020 incremental_mapper.cc:393] => Image sees 721 / 3740 points
I1011 15:32:32.216540 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.216559 210020 incremental_mapper.cc:390] Registering image #46 (3)
I1011 15:32:32.216588 210020 incremental_mapper.cc:393] => Image sees 654 / 3240 points
I1011 15:32:32.216917 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.216931 210020 incremental_mapper.cc:390] Registering image #45 (3)
I1011 15:32:32.216934 210020 incremental_mapper.cc:393] => Image sees 567 / 1958 points
I1011 15:32:32.217048 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.217125 210020 incremental_mapper.cc:390] Registering image #47 (3)
I1011 15:32:32.217130 210020 incremental_mapper.cc:393] => Image sees 576 / 3099 points
I1011 15:32:32.217283 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.217300 210020 incremental_mapper.cc:390] Registering image #40 (3)
I1011 15:32:32.217304 210020 incremental_mapper.cc:393] => Image sees 595 / 3644 points
I1011 15:32:32.217486 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.217499 210020 incremental_mapper.cc:390] Registering image #48 (3)
I1011 15:32:32.217500 210020 incremental_mapper.cc:393] => Image sees 532 / 3002 points
I1011 15:32:32.217612 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.217621 210020 incremental_mapper.cc:390] Registering image #39 (3)
I1011 15:32:32.217623 210020 incremental_mapper.cc:393] => Image sees 515 / 3864 points
I1011 15:32:32.217774 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.217783 210020 incremental_mapper.cc:390] Registering image #49 (3)
I1011 15:32:32.217785 210020 incremental_mapper.cc:393] => Image sees 374 / 1858 points
I1011 15:32:32.217855 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.217864 210020 incremental_mapper.cc:390] Registering image #50 (3)
I1011 15:32:32.217865 210020 incremental_mapper.cc:393] => Image sees 352 / 1882 points
I1011 15:32:32.217947 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.217954 210020 incremental_mapper.cc:390] Registering image #51 (3)
I1011 15:32:32.217990 210020 incremental_mapper.cc:393] => Image sees 391 / 2848 points
I1011 15:32:32.218120 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.218132 210020 incremental_mapper.cc:390] Registering image #38 (3)
I1011 15:32:32.218133 210020 incremental_mapper.cc:393] => Image sees 390 / 3757 points
I1011 15:32:32.218259 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.218266 210020 incremental_mapper.cc:390] Registering image #52 (3)
I1011 15:32:32.218268 210020 incremental_mapper.cc:393] => Image sees 364 / 2916 points
I1011 15:32:32.218369 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.218376 210020 incremental_mapper.cc:390] Registering image #53 (3)
I1011 15:32:32.218377 210020 incremental_mapper.cc:393] => Image sees 352 / 2959 points
I1011 15:32:32.218478 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.218487 210020 incremental_mapper.cc:390] Registering image #37 (3)
I1011 15:32:32.218488 210020 incremental_mapper.cc:393] => Image sees 322 / 3326 points
I1011 15:32:32.218595 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.218602 210020 incremental_mapper.cc:390] Registering image #54 (3)
I1011 15:32:32.218604 210020 incremental_mapper.cc:393] => Image sees 304 / 2897 points
I1011 15:32:32.218706 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.218714 210020 incremental_mapper.cc:390] Registering image #36 (3)
I1011 15:32:32.218716 210020 incremental_mapper.cc:393] => Image sees 279 / 3513 points
I1011 15:32:32.218837 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.218844 210020 incremental_mapper.cc:390] Registering image #35 (3)
I1011 15:32:32.218847 210020 incremental_mapper.cc:393] => Image sees 213 / 3283 points
I1011 15:32:32.218947 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.218955 210020 incremental_mapper.cc:390] Registering image #56 (3)
I1011 15:32:32.218957 210020 incremental_mapper.cc:393] => Image sees 202 / 3074 points
I1011 15:32:32.219066 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.219074 210020 incremental_mapper.cc:390] Registering image #55 (3)
I1011 15:32:32.219076 210020 incremental_mapper.cc:393] => Image sees 200 / 2681 points
I1011 15:32:32.219166 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.219173 210020 incremental_mapper.cc:390] Registering image #34 (3)
I1011 15:32:32.219175 210020 incremental_mapper.cc:393] => Image sees 186 / 3036 points
I1011 15:32:32.219270 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.219278 210020 incremental_mapper.cc:390] Registering image #58 (3)
I1011 15:32:32.219280 210020 incremental_mapper.cc:393] => Image sees 166 / 3320 points
I1011 15:32:32.219380 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.219388 210020 incremental_mapper.cc:390] Registering image #57 (3)
I1011 15:32:32.219390 210020 incremental_mapper.cc:393] => Image sees 170 / 3240 points
I1011 15:32:32.219489 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.219497 210020 incremental_mapper.cc:390] Registering image #33 (3)
I1011 15:32:32.219499 210020 incremental_mapper.cc:393] => Image sees 166 / 2995 points
I1011 15:32:32.219592 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.219600 210020 incremental_mapper.cc:390] Registering image #32 (3)
I1011 15:32:32.219602 210020 incremental_mapper.cc:393] => Image sees 166 / 3177 points
I1011 15:32:32.219703 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.219712 210020 incremental_mapper.cc:390] Registering image #60 (3)
I1011 15:32:32.219713 210020 incremental_mapper.cc:393] => Image sees 132 / 3414 points
I1011 15:32:32.219817 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.219825 210020 incremental_mapper.cc:390] Registering image #59 (3)
I1011 15:32:32.219827 210020 incremental_mapper.cc:393] => Image sees 127 / 2278 points
I1011 15:32:32.219997 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.220017 210020 incremental_mapper.cc:390] Registering image #31 (3)
I1011 15:32:32.220065 210020 incremental_mapper.cc:393] => Image sees 113 / 2964 points
I1011 15:32:32.220191 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.220202 210020 incremental_mapper.cc:390] Registering image #29 (3)
I1011 15:32:32.220204 210020 incremental_mapper.cc:393] => Image sees 106 / 3102 points
I1011 15:32:32.220310 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.220319 210020 incremental_mapper.cc:390] Registering image #30 (3)
I1011 15:32:32.220321 210020 incremental_mapper.cc:393] => Image sees 110 / 3281 points
I1011 15:32:32.220422 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.220429 210020 incremental_mapper.cc:390] Registering image #61 (3)
I1011 15:32:32.220431 210020 incremental_mapper.cc:393] => Image sees 94 / 3592 points
I1011 15:32:32.220544 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.220553 210020 incremental_mapper.cc:42] Retriangulation and Global bundle adjustment
I1011 15:32:32.454140 210020 incremental_mapper.cc:390] Registering image #62 (3)
I1011 15:32:32.454169 210020 incremental_mapper.cc:393] => Image sees 88 / 3632 points
I1011 15:32:32.454286 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.454296 210020 incremental_mapper.cc:390] Registering image #63 (3)
I1011 15:32:32.454298 210020 incremental_mapper.cc:393] => Image sees 79 / 3720 points
I1011 15:32:32.454409 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.454418 210020 incremental_mapper.cc:390] Registering image #64 (3)
I1011 15:32:32.454421 210020 incremental_mapper.cc:393] => Image sees 78 / 3512 points
I1011 15:32:32.454535 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.454545 210020 incremental_mapper.cc:390] Registering image #28 (3)
I1011 15:32:32.454546 210020 incremental_mapper.cc:393] => Image sees 62 / 1543 points
I1011 15:32:32.454603 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.454622 210020 incremental_mapper.cc:390] Registering image #25 (3)
I1011 15:32:32.454623 210020 incremental_mapper.cc:393] => Image sees 59 / 2349 points
I1011 15:32:32.454722 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.454730 210020 incremental_mapper.cc:390] Registering image #27 (3)
I1011 15:32:32.454732 210020 incremental_mapper.cc:393] => Image sees 62 / 2519 points
I1011 15:32:32.454811 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.454819 210020 incremental_mapper.cc:390] Registering image #65 (3)
I1011 15:32:32.454821 210020 incremental_mapper.cc:393] => Image sees 55 / 3587 points
I1011 15:32:32.454928 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.454936 210020 incremental_mapper.cc:390] Registering image #23 (3)
I1011 15:32:32.454938 210020 incremental_mapper.cc:393] => Image sees 54 / 2208 points
I1011 15:32:32.455008 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.455014 210020 incremental_mapper.cc:390] Registering image #66 (3)
I1011 15:32:32.455016 210020 incremental_mapper.cc:393] => Image sees 46 / 3770 points
I1011 15:32:32.455147 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.455155 210020 incremental_mapper.cc:390] Registering image #22 (3)
I1011 15:32:32.455159 210020 incremental_mapper.cc:393] => Image sees 44 / 2158 points
I1011 15:32:32.455224 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.455232 210020 incremental_mapper.cc:390] Registering image #26 (3)
I1011 15:32:32.455233 210020 incremental_mapper.cc:393] => Image sees 38 / 1383 points
I1011 15:32:32.455276 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.455284 210020 incremental_mapper.cc:390] Registering image #67 (3)
I1011 15:32:32.455286 210020 incremental_mapper.cc:393] => Image sees 39 / 3690 points
I1011 15:32:32.455410 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.455420 210020 incremental_mapper.cc:390] Registering image #8 (3)
I1011 15:32:32.455421 210020 incremental_mapper.cc:393] => Image sees 32 / 1845 points
I1011 15:32:32.455489 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.455497 210020 incremental_mapper.cc:390] Registering image #21 (3)
I1011 15:32:32.455499 210020 incremental_mapper.cc:393] => Image sees 31 / 1945 points
I1011 15:32:32.455557 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.455565 210020 incremental_mapper.cc:390] Registering image #74 (3)
I1011 15:32:32.455567 210020 incremental_mapper.cc:393] => Image sees 31 / 3483 points
I1011 15:32:32.455663 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.455672 210020 incremental_mapper.cc:390] Registering image #24 (3)
I1011 15:32:32.455673 210020 incremental_mapper.cc:393] => Image sees 30 / 1282 points
I1011 15:32:32.455716 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.455724 210020 incremental_mapper.cc:390] Registering image #43 (3)
I1011 15:32:32.455726 210020 incremental_mapper.cc:393] => Image sees 749 / 2179 points
I1011 15:32:32.455843 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.455852 210020 incremental_mapper.cc:390] Registering image #41 (3)
I1011 15:32:32.455853 210020 incremental_mapper.cc:393] => Image sees 721 / 3740 points
I1011 15:32:32.455998 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.456007 210020 incremental_mapper.cc:390] Registering image #46 (3)
I1011 15:32:32.456009 210020 incremental_mapper.cc:393] => Image sees 654 / 3240 points
I1011 15:32:32.456136 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.456146 210020 incremental_mapper.cc:390] Registering image #45 (3)
I1011 15:32:32.456146 210020 incremental_mapper.cc:393] => Image sees 567 / 1958 points
I1011 15:32:32.456235 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.456243 210020 incremental_mapper.cc:390] Registering image #47 (3)
I1011 15:32:32.456245 210020 incremental_mapper.cc:393] => Image sees 576 / 3099 points
I1011 15:32:32.456367 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.456374 210020 incremental_mapper.cc:390] Registering image #40 (3)
I1011 15:32:32.456377 210020 incremental_mapper.cc:393] => Image sees 595 / 3644 points
I1011 15:32:32.456506 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.456513 210020 incremental_mapper.cc:390] Registering image #48 (3)
I1011 15:32:32.456516 210020 incremental_mapper.cc:393] => Image sees 532 / 3002 points
I1011 15:32:32.456635 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.456773 210020 incremental_mapper.cc:390] Registering image #39 (3)
I1011 15:32:32.456782 210020 incremental_mapper.cc:393] => Image sees 515 / 3864 points
I1011 15:32:32.456946 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.456960 210020 incremental_mapper.cc:390] Registering image #49 (3)
I1011 15:32:32.456971 210020 incremental_mapper.cc:393] => Image sees 374 / 1858 points
I1011 15:32:32.457093 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.457101 210020 incremental_mapper.cc:390] Registering image #50 (3)
I1011 15:32:32.457103 210020 incremental_mapper.cc:393] => Image sees 352 / 1882 points
I1011 15:32:32.457190 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.457198 210020 incremental_mapper.cc:390] Registering image #51 (3)
I1011 15:32:32.457199 210020 incremental_mapper.cc:393] => Image sees 391 / 2848 points
I1011 15:32:32.457298 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.457306 210020 incremental_mapper.cc:390] Registering image #38 (3)
I1011 15:32:32.457307 210020 incremental_mapper.cc:393] => Image sees 390 / 3757 points
I1011 15:32:32.457440 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.457448 210020 incremental_mapper.cc:390] Registering image #52 (3)
I1011 15:32:32.457450 210020 incremental_mapper.cc:393] => Image sees 364 / 2916 points
I1011 15:32:32.457551 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.457559 210020 incremental_mapper.cc:390] Registering image #53 (3)
I1011 15:32:32.457561 210020 incremental_mapper.cc:393] => Image sees 352 / 2959 points
I1011 15:32:32.457661 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.457669 210020 incremental_mapper.cc:390] Registering image #37 (3)
I1011 15:32:32.457671 210020 incremental_mapper.cc:393] => Image sees 322 / 3326 points
I1011 15:32:32.457779 210020 incremental_mapper.cc:404] => Could not register, trying another image.
I1011 15:32:32.469709 210020 timer.cc:91] Elapsed time: 0.015 [minutes]
I1011 15:32:32.536317 210022 misc.cc:44] 
==============================================================================
Reading reconstruction
==============================================================================
I1011 15:32:32.544337 210022 image.cc:347] => Reconstruction with 2 images and 1363 points
I1011 15:32:32.544355 210022 misc.cc:44]
==============================================================================
Image undistortion
==============================================================================
I1011 15:32:32.554471 210022 undistortion.cc:215] Undistorting image [1/2]
I1011 15:32:32.610159 210022 undistortion.cc:215] Undistorting image [2/2]
I1011 15:32:32.610181 210022 undistortion.cc:225] Writing reconstruction...
I1011 15:32:32.620537 210022 undistortion.cc:230] Writing configuration...
I1011 15:32:32.623773 210022 undistortion.cc:234] Writing scripts...
I1011 15:32:32.627941 210022 timer.cc:91] Elapsed time: 0.001 [minutes]
Optimizing /mnt/d/rotate_chair
Output folder: /mnt/d/rotate_chair [11/10 15:32:33]
Reading camera 2/2 [11/10 15:32:33]
Converting point3d.bin to .ply, will happen only the first time you open the scene. [11/10 15:32:33]
Loading Training Cameras [11/10 15:32:33]
Loading Test Cameras [11/10 15:32:34]
Number of points at initialisation :  1363 [11/10 15:32:34]
Training progress:  23%|████████████████████▌                                                                   | 7000/30000 [00:54<02:51, 133.99it/s, Loss=0.0065778]
[ITER 7000] Evaluating train: L1 0.004105021618306637 PSNR 44.20554962158204 [11/10 15:33:30]

[ITER 7000] Saving Gaussians [11/10 15:33:30]
Training progress: 100%|███████████████████████████████████████████████████████████████████████████████████████| 30000/30000 [03:24<00:00, 146.86it/s, Loss=0.0032433]

[ITER 30000] Evaluating train: L1 0.0022015979047864676 PSNR 49.12659454345703 [11/10 15:35:59]

[ITER 30000] Saving Gaussians [11/10 15:35:59]

Training complete. [11/10 15:35:59]
num views: 2
baseline: 0.35000000303186307
Loading trained model at iteration 30000
Reading camera 2/2
Loading Training Cameras
Loading Test Cameras
  0%|                                                                                                                                           | 0/2 [00:00<?, ?it/s]
UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3609.)
UserWarning: Default grid_sample and affine_grid behavior has changed to align_corners=False since 1.3.0. Please specify align_corners=True if the old behavior is desired. See the documentation of grid_sample for details.
100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:01<00:00,  1.38it/s]
Automask must be enabled for masking in script mode. Skipping.
100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:00<00:00, 33.08it/s][Open3D WARNING] Write PLY failed: mesh has 0 vertices.
SAVED MESH
[Open3D DEBUG] [ClusterConnectedTriangles] Compute triangle adjacency
[Open3D DEBUG] [ClusterConnectedTriangles] Done computing triangle adjacency
[Open3D DEBUG] [ClusterConnectedTriangles] Done clustering, #clusters=0
[Open3D WARNING] Write PLY failed: mesh has 0 vertices.

From the output you sent, COLMAP is failing to find good correspondences, meaning that its output is empty, causing the rest of the pipeline to fail.

Assuming you have enough views, it happens sometimes when using the COLMAP exhaustive matcher. A quick fix would be to change to the sequential matcher, and replace line 224 in gs2mesh_utils/colmap_utils.py:

os.system(f"colmap exhaustive_matcher --database_path {database_dir} --SiftMatching.use_gpu {'1' if use_gpu else '0'}")

with:

os.system(f"colmap sequential_matcher --database_path {database_dir} --SiftMatching.use_gpu {'1' if use_gpu else '0'}")

Let me know if this works. Should probably solve the issue for @KaedeGo as well.

@yanivw12 This is for custom data. I saw in your repository README, it says when reconstructing using custom data (image only, without COLMAP), it only requires image as inputs? Do we need to contain camera info or other files? How are the formats of them?

In general, you only need the images as inputs, since COLMAP finds the camera info based on them. It will save a sparse model with the intrinsic and extrinsic camera parameters in the same directory as the source images. That will be used as input for the Gaussian Splatting.