revisionarian
commented
2 years ago Hi @CARLSOUP, thanks for trying out MeshroomCL. From your log messages, we see that during execution of the MultiviewStereoCL node, the depth map fusion step is fusing zero points. I am unsure whether the problem is with your input images, or if the MultiviewStereoCL node is failing to make good depth maps for some other reason.
Here's a few ideas that would help us debug this problem:
- Could you try running MeshroomCL on a standard dataset, such as the Sceaux Castle dataset (11 images), available here: https://github.com/openMVG/ImageDataset_SceauxCastle ? If that works on your machine, then there is probably a problem with your specific input images.
- Alternatively, you could post or send us your 5 images that caused the problem corresponding to the error log you posted here.
- When you ran MeshroomCL on this dataset of 5 images, did the results of the StructureFromMotionCL node (which are displayed in the 3D window before the MultiviewStereoCL node starts) look reasonable? That is, were the 5 cameras positioned roughly like you expected them to be? How many points were in the sparse point cloud?
I don't know what happened or where to begin with troubleshooting. I have tried multible times with different versions of Meshroom and different Cameras.
============================================================================== Image undistortion
Undistorting image [1/5] Undistorting image [2/5] Undistorting image [3/5] Undistorting image [4/5] Undistorting image [5/5] Writing reconstruction... Writing configuration... Writing scripts... Elapsed time: 0.050 [minutes] Reading workspace... Reading configuration... Configuration has 5 problems...
============================================================================== Processing view 1 / 5
Reading inputs...
PatchMatch::Problem
ref_image_idx: 0 src_image_idxs: 3 1 4 2
PatchMatchOptions
max_image_size: 3200 gpu_index: 0 depth_min: 9.65072 depth_max: 38.7638 window_radius: 5 window_step: 1 sigma_spatial: 5 sigma_color: 0.2 num_samples: 15 ncc_sigma: 0.6 min_triangulation_angle: 1 incident_angle_sigma: 0.9 num_iterations: 5 geom_consistency: 0 geom_consistency_regularizer: 0.3 geom_consistency_max_cost: 3 filter: 1 filter_min_ncc: 0.1 filter_min_triangulation_angle: 3 filter_min_num_consistent: 2 filter_geom_consistency_max_cost: 1 write_consistency_graph: 0
PatchMatch::Run
OpenCL platform : AMD Accelerated Parallel Processing OpenCL device : gfx902 Initialization: 0.080585s Sweep 1: 0.159463s Sweep 2: 0.164437s Sweep 3: 0.156206s Sweep 4: 0.165767s Iteration 1: 0.646301s Sweep 1: 0.153236s Sweep 2: 0.167028s Sweep 3: 0.157655s Sweep 4: 0.15874s Iteration 2: 0.636996s Sweep 1: 0.153642s Sweep 2: 0.16198s Sweep 3: 0.155905s Sweep 4: 0.165524s Iteration 3: 0.637447s Sweep 1: 0.15103s Sweep 2: 0.162097s Sweep 3: 0.152305s Sweep 4: 0.161991s Iteration 4: 0.627758s Sweep 1: 0.151241s Sweep 2: 0.162211s Sweep 3: 0.153037s Sweep 4: 0.160901s Iteration 5: 0.627796s Filtering: 0.001737s Total: 3.25889s
Writing photometric output for 1760748833.jpg
============================================================================== Processing view 2 / 5
Reading inputs...
PatchMatch::Problem
ref_image_idx: 1 src_image_idxs: 0 3 2
PatchMatchOptions
max_image_size: 3200 gpu_index: 0 depth_min: 16.3735 depth_max: 31.5586 window_radius: 5 window_step: 1 sigma_spatial: 5 sigma_color: 0.2 num_samples: 15 ncc_sigma: 0.6 min_triangulation_angle: 1 incident_angle_sigma: 0.9 num_iterations: 5 geom_consistency: 0 geom_consistency_regularizer: 0.3 geom_consistency_max_cost: 3 filter: 1 filter_min_ncc: 0.1 filter_min_triangulation_angle: 3 filter_min_num_consistent: 2 filter_geom_consistency_max_cost: 1 write_consistency_graph: 0
PatchMatch::Run
OpenCL platform : AMD Accelerated Parallel Processing OpenCL device : gfx902 Initialization: 0.060878s Sweep 1: 0.126025s Sweep 2: 0.139309s Sweep 3: 0.115948s Sweep 4: 0.132034s Iteration 1: 0.514079s Sweep 1: 0.119579s Sweep 2: 0.139652s Sweep 3: 0.119148s Sweep 4: 0.140303s Iteration 2: 0.519246s Sweep 1: 0.121964s Sweep 2: 0.138622s Sweep 3: 0.121885s Sweep 4: 0.134747s Iteration 3: 0.517624s Sweep 1: 0.120683s Sweep 2: 0.139798s Sweep 3: 0.122296s Sweep 4: 0.137765s Iteration 4: 0.520894s Sweep 1: 0.120368s Sweep 2: 0.137865s Sweep 3: 0.117608s Sweep 4: 0.131314s Iteration 5: 0.507502s Filtering: 0.005385s Total: 2.64594s
Writing photometric output for 2041479227.jpg
============================================================================== Processing view 3 / 5
Reading inputs...
PatchMatch::Problem
ref_image_idx: 2 src_image_idxs: 0 1 4 3
PatchMatchOptions
max_image_size: 3200 gpu_index: 0 depth_min: 15.9165 depth_max: 29.1074 window_radius: 5 window_step: 1 sigma_spatial: 5 sigma_color: 0.2 num_samples: 15 ncc_sigma: 0.6 min_triangulation_angle: 1 incident_angle_sigma: 0.9 num_iterations: 5 geom_consistency: 0 geom_consistency_regularizer: 0.3 geom_consistency_max_cost: 3 filter: 1 filter_min_ncc: 0.1 filter_min_triangulation_angle: 3 filter_min_num_consistent: 2 filter_geom_consistency_max_cost: 1 write_consistency_graph: 0
PatchMatch::Run
OpenCL platform : AMD Accelerated Parallel Processing OpenCL device : gfx902 Initialization: 0.084301s Sweep 1: 0.15076s Sweep 2: 0.16051s Sweep 3: 0.151217s Sweep 4: 0.161514s Iteration 1: 0.624334s Sweep 1: 0.153756s Sweep 2: 0.16078s Sweep 3: 0.151105s Sweep 4: 0.163333s Iteration 2: 0.629304s Sweep 1: 0.151875s Sweep 2: 0.16177s Sweep 3: 0.150033s Sweep 4: 0.164845s Iteration 3: 0.628981s Sweep 1: 0.154652s Sweep 2: 0.169599s Sweep 3: 0.163992s Sweep 4: 0.168512s Iteration 4: 0.657065s Sweep 1: 0.15237s Sweep 2: 0.163302s Sweep 3: 0.150594s Sweep 4: 0.159319s Iteration 5: 0.625975s Filtering: 0.001739s Total: 3.25197s
Writing photometric output for 217128347.jpg
============================================================================== Processing view 4 / 5
Reading inputs...
PatchMatch::Problem
ref_image_idx: 3 src_image_idxs: 4 0 1 2
PatchMatchOptions
max_image_size: 3200 gpu_index: 0 depth_min: 11.7596 depth_max: 46.3138 window_radius: 5 window_step: 1 sigma_spatial: 5 sigma_color: 0.2 num_samples: 15 ncc_sigma: 0.6 min_triangulation_angle: 1 incident_angle_sigma: 0.9 num_iterations: 5 geom_consistency: 0 geom_consistency_regularizer: 0.3 geom_consistency_max_cost: 3 filter: 1 filter_min_ncc: 0.1 filter_min_triangulation_angle: 3 filter_min_num_consistent: 2 filter_geom_consistency_max_cost: 1 write_consistency_graph: 0
PatchMatch::Run
OpenCL platform : AMD Accelerated Parallel Processing OpenCL device : gfx902 Initialization: 0.08475s Sweep 1: 0.15193s Sweep 2: 0.162028s Sweep 3: 0.154213s Sweep 4: 0.160372s Iteration 1: 0.628893s Sweep 1: 0.153695s Sweep 2: 0.164144s Sweep 3: 0.151808s Sweep 4: 0.163542s Iteration 2: 0.633529s Sweep 1: 0.152356s Sweep 2: 0.163514s Sweep 3: 0.16872s Sweep 4: 0.167298s Iteration 3: 0.652232s Sweep 1: 0.151864s Sweep 2: 0.160788s Sweep 3: 0.152228s Sweep 4: 0.164365s Iteration 4: 0.62958s Sweep 1: 0.150932s Sweep 2: 0.163635s Sweep 3: 0.151237s Sweep 4: 0.160262s Iteration 5: 0.626591s Filtering: 0.001722s Total: 3.25755s
Writing photometric output for 514911003.jpg
============================================================================== Processing view 5 / 5
Reading inputs...
PatchMatch::Problem
ref_image_idx: 4 src_image_idxs: 3 0 2
PatchMatchOptions
max_image_size: 3200 gpu_index: 0 depth_min: 16.9182 depth_max: 32.0085 window_radius: 5 window_step: 1 sigma_spatial: 5 sigma_color: 0.2 num_samples: 15 ncc_sigma: 0.6 min_triangulation_angle: 1 incident_angle_sigma: 0.9 num_iterations: 5 geom_consistency: 0 geom_consistency_regularizer: 0.3 geom_consistency_max_cost: 3 filter: 1 filter_min_ncc: 0.1 filter_min_triangulation_angle: 3 filter_min_num_consistent: 2 filter_geom_consistency_max_cost: 1 write_consistency_graph: 0
PatchMatch::Run
OpenCL platform : AMD Accelerated Parallel Processing OpenCL device : gfx902 Initialization: 0.064362s Sweep 1: 0.113198s Sweep 2: 0.147076s Sweep 3: 0.117674s Sweep 4: 0.130531s Iteration 1: 0.508826s Sweep 1: 0.118903s Sweep 2: 0.132133s Sweep 3: 0.120374s Sweep 4: 0.135384s Iteration 2: 0.507183s Sweep 1: 0.114831s Sweep 2: 0.172515s Sweep 3: 0.154031s Sweep 4: 0.151465s Iteration 3: 0.59313s Sweep 1: 0.121543s Sweep 2: 0.139034s Sweep 3: 0.12336s Sweep 4: 0.135865s Iteration 4: 0.520226s Sweep 1: 0.118892s Sweep 2: 0.139016s Sweep 3: 0.116277s Sweep 4: 0.135073s Iteration 5: 0.509596s Filtering: 0.001716s Total: 2.70527s
Writing photometric output for 541251440.jpg Elapsed time: 0.324 [minutes] Reading workspace... Reading configuration... Configuration has 5 problems...
============================================================================== Processing view 1 / 5
Reading inputs...
PatchMatch::Problem
ref_image_idx: 0 src_image_idxs: 3 1 4 2
PatchMatchOptions
max_image_size: 3200 gpu_index: 0 depth_min: 9.65072 depth_max: 38.7638 window_radius: 5 window_step: 1 sigma_spatial: 5 sigma_color: 0.2 num_samples: 15 ncc_sigma: 0.6 min_triangulation_angle: 1 incident_angle_sigma: 0.9 num_iterations: 5 geom_consistency: 1 geom_consistency_regularizer: 0.3 geom_consistency_max_cost: 3 filter: 1 filter_min_ncc: 0.1 filter_min_triangulation_angle: 3 filter_min_num_consistent: 2 filter_geom_consistency_max_cost: 1 write_consistency_graph: 0
PatchMatch::Run
OpenCL platform : AMD Accelerated Parallel Processing OpenCL device : gfx902 Initialization: 0.084967s Sweep 1: 0.167041s Sweep 2: 0.181618s Sweep 3: 0.161849s Sweep 4: 0.173745s Iteration 1: 0.684596s Sweep 1: 0.167565s Sweep 2: 0.179439s Sweep 3: 0.167208s Sweep 4: 0.173977s Iteration 2: 0.688602s Sweep 1: 0.159507s Sweep 2: 0.17278s Sweep 3: 0.160193s Sweep 4: 0.171293s Iteration 3: 0.664109s Sweep 1: 0.163168s Sweep 2: 0.171637s Sweep 3: 0.162162s Sweep 4: 0.172394s Iteration 4: 0.669782s Sweep 1: 0.173325s Sweep 2: 0.172291s Sweep 3: 0.162401s Sweep 4: 0.171964s Iteration 5: 0.680314s Filtering: 0.00398s Total: 3.47665s
Writing geometric output for 1760748833.jpg
============================================================================== Processing view 2 / 5
Reading inputs...
PatchMatch::Problem
ref_image_idx: 1 src_image_idxs: 0 3 2
PatchMatchOptions
max_image_size: 3200 gpu_index: 0 depth_min: 16.3735 depth_max: 31.5586 window_radius: 5 window_step: 1 sigma_spatial: 5 sigma_color: 0.2 num_samples: 15 ncc_sigma: 0.6 min_triangulation_angle: 1 incident_angle_sigma: 0.9 num_iterations: 5 geom_consistency: 1 geom_consistency_regularizer: 0.3 geom_consistency_max_cost: 3 filter: 1 filter_min_ncc: 0.1 filter_min_triangulation_angle: 3 filter_min_num_consistent: 2 filter_geom_consistency_max_cost: 1 write_consistency_graph: 0
PatchMatch::Run
OpenCL platform : AMD Accelerated Parallel Processing OpenCL device : gfx902 Initialization: 0.061806s Sweep 1: 0.126146s Sweep 2: 0.149967s Sweep 3: 0.127507s Sweep 4: 0.163543s Iteration 1: 0.567549s Sweep 1: 0.126552s Sweep 2: 0.147164s Sweep 3: 0.125239s Sweep 4: 0.143186s Iteration 2: 0.54248s Sweep 1: 0.122383s Sweep 2: 0.144344s Sweep 3: 0.122885s Sweep 4: 0.14351s Iteration 3: 0.533458s Sweep 1: 0.121749s Sweep 2: 0.144244s Sweep 3: 0.122294s Sweep 4: 0.143958s Iteration 4: 0.532577s Sweep 1: 0.1219s Sweep 2: 0.146438s Sweep 3: 0.129007s Sweep 4: 0.144366s Iteration 5: 0.542099s Filtering: 0.001923s Total: 2.78213s
Writing geometric output for 2041479227.jpg
============================================================================== Processing view 3 / 5
Reading inputs...
PatchMatch::Problem
ref_image_idx: 2 src_image_idxs: 0 1 4 3
PatchMatchOptions
max_image_size: 3200 gpu_index: 0 depth_min: 15.9165 depth_max: 29.1074 window_radius: 5 window_step: 1 sigma_spatial: 5 sigma_color: 0.2 num_samples: 15 ncc_sigma: 0.6 min_triangulation_angle: 1 incident_angle_sigma: 0.9 num_iterations: 5 geom_consistency: 1 geom_consistency_regularizer: 0.3 geom_consistency_max_cost: 3 filter: 1 filter_min_ncc: 0.1 filter_min_triangulation_angle: 3 filter_min_num_consistent: 2 filter_geom_consistency_max_cost: 1 write_consistency_graph: 0
PatchMatch::Run
OpenCL platform : AMD Accelerated Parallel Processing OpenCL device : gfx902 Initialization: 0.074922s Sweep 1: 0.164343s Sweep 2: 0.171713s Sweep 3: 0.159325s Sweep 4: 0.173207s Iteration 1: 0.669027s Sweep 1: 0.159102s Sweep 2: 0.174442s Sweep 3: 0.160164s Sweep 4: 0.172703s Iteration 2: 0.666863s Sweep 1: 0.157871s Sweep 2: 0.175194s Sweep 3: 0.15766s Sweep 4: 0.169915s Iteration 3: 0.661086s Sweep 1: 0.162381s Sweep 2: 0.176746s Sweep 3: 0.158507s Sweep 4: 0.171704s Iteration 4: 0.669738s Sweep 1: 0.158383s Sweep 2: 0.175549s Sweep 3: 0.159085s Sweep 4: 0.173724s Iteration 5: 0.667351s Filtering: 0.002756s Total: 3.41206s
Writing geometric output for 217128347.jpg
============================================================================== Processing view 4 / 5
Reading inputs...
PatchMatch::Problem
ref_image_idx: 3 src_image_idxs: 4 0 1 2
PatchMatchOptions
max_image_size: 3200 gpu_index: 0 depth_min: 11.7596 depth_max: 46.3138 window_radius: 5 window_step: 1 sigma_spatial: 5 sigma_color: 0.2 num_samples: 15 ncc_sigma: 0.6 min_triangulation_angle: 1 incident_angle_sigma: 0.9 num_iterations: 5 geom_consistency: 1 geom_consistency_regularizer: 0.3 geom_consistency_max_cost: 3 filter: 1 filter_min_ncc: 0.1 filter_min_triangulation_angle: 3 filter_min_num_consistent: 2 filter_geom_consistency_max_cost: 1 write_consistency_graph: 0
PatchMatch::Run
OpenCL platform : AMD Accelerated Parallel Processing OpenCL device : gfx902 Initialization: 0.074571s Sweep 1: 0.165869s Sweep 2: 0.17732s Sweep 3: 0.166947s Sweep 4: 0.176728s Iteration 1: 0.687196s Sweep 1: 0.167681s Sweep 2: 0.175473s Sweep 3: 0.160124s Sweep 4: 0.176012s Iteration 2: 0.679677s Sweep 1: 0.160319s Sweep 2: 0.177734s Sweep 3: 0.164463s Sweep 4: 0.185292s Iteration 3: 0.688257s Sweep 1: 0.164948s Sweep 2: 0.178625s Sweep 3: 0.160241s Sweep 4: 0.177564s Iteration 4: 0.681885s Sweep 1: 0.16369s Sweep 2: 0.173482s Sweep 3: 0.16387s Sweep 4: 0.173825s Iteration 5: 0.675244s Filtering: 0.00363s Total: 3.49111s
Writing geometric output for 514911003.jpg
============================================================================== Processing view 5 / 5
Reading inputs...
PatchMatch::Problem
ref_image_idx: 4 src_image_idxs: 3 0 2
PatchMatchOptions
max_image_size: 3200 gpu_index: 0 depth_min: 16.9182 depth_max: 32.0085 window_radius: 5 window_step: 1 sigma_spatial: 5 sigma_color: 0.2 num_samples: 15 ncc_sigma: 0.6 min_triangulation_angle: 1 incident_angle_sigma: 0.9 num_iterations: 5 geom_consistency: 1 geom_consistency_regularizer: 0.3 geom_consistency_max_cost: 3 filter: 1 filter_min_ncc: 0.1 filter_min_triangulation_angle: 3 filter_min_num_consistent: 2 filter_geom_consistency_max_cost: 1 write_consistency_graph: 0
PatchMatch::Run
OpenCL platform : AMD Accelerated Parallel Processing OpenCL device : gfx902 Initialization: 0.057357s Sweep 1: 0.124737s Sweep 2: 0.145902s Sweep 3: 0.126875s Sweep 4: 0.141233s Iteration 1: 0.539074s Sweep 1: 0.124839s Sweep 2: 0.143366s Sweep 3: 0.125222s Sweep 4: 0.143616s Iteration 2: 0.537381s Sweep 1: 0.12472s Sweep 2: 0.142533s Sweep 3: 0.125061s Sweep 4: 0.143283s Iteration 3: 0.53601s Sweep 1: 0.123342s Sweep 2: 0.141498s Sweep 3: 0.12361s Sweep 4: 0.155798s Iteration 4: 0.544567s Sweep 1: 0.121986s Sweep 2: 0.141991s Sweep 3: 0.123504s Sweep 4: 0.143203s Iteration 5: 0.531127s Filtering: 0.002718s Total: 2.74846s
Writing geometric output for 541251440.jpg Elapsed time: 0.366 [minutes]
StereoFusion::Options
max_image_size: 3200 min_num_pixels: 5 max_num_pixels: 10000 max_traversal_depth: 100 max_reproj_error: 2 max_depth_error: 0.01 max_normal_error: 10 check_num_images: 50 cache_size: 32
Reading workspace... Reading configuration... Fusing image [1/5] in 0.045s (0 points) Fusing image [2/5] in 0.046s (0 points) Fusing image [3/5] in 0.037s (0 points) Fusing image [4/5] in 0.026s (0 points) Fusing image [5/5] in 0.021s (0 points) WARNING: Could not fuse any points. This is likely caused by incorrect settings - filtering must be enabled for the last call to patch match stereo. Number of fused points: 0 Elapsed time: 0.006 [minutes] Writing output: C:/Users/**~1/AppData/Local/Temp/MeshroomCache/MultiviewStereoCL/628924d318a0c5d136cd7dd59127e29c3f32c8bd\fused.ply Triangulating points... Triangulation has 0 using 0 points. Initializing ray tracer... F0828 20:10:58.126077 18424 math.h:233] Check failed: !elems.empty() Check failure stack trace: *** @ 00007FFB7F425FCB public: void cdecl google::LogMessage::Flush(void) ptr64 @ 00007FFB7F424B29 public: cdecl google::LogMessageFatal::~LogMessageFatal(void) ptr64 @ 00007FF65241D401 (unknown) @ 00007FF652432EA2 (unknown) @ 00007FF65243B72E (unknown) @ 00007FF65243CFBC (unknown) @ 00007FF6522FF849 (unknown) @ 00007FF6522F17A6 (unknown) @ 00007FF6523341BF (unknown) @ 00007FF65284EB24 (unknown) @ 00007FFBE97A7034 BaseThreadInitThunk @ 00007FFBEB222651 RtlUserThreadStart