ewrfcas / MVSFormer

Codes of MVSFormer: Multi-View Stereo by Learning Robust Image Features and Temperature-based Depth (TMLR2023)
Apache License 2.0
175 stars 10 forks source link

Problem in depth map fusion & filter step #35

Closed BoiMat closed 4 months ago

BoiMat commented 5 months ago

Hello everyone, hope you can help me! During the fusion & filter step of testing MVSFormer on the DTU testset, the script tries to load images saved as .png while they are .jpg and then loads 0 points per camera.

This is the output:

filter depth map with probability map filtering: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 49/49 [00:02<00:00, 20.97it/s] Convert mvsnet output to gipuma input convert depth maps: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 49/49 [00:56<00:00, 1.16s/it] Run depth map fusion & filter ./fusibile/fusibile -input_folder exps/dtu_test/scan1/points_mvsnet/ -p_folder exps/dtu_test/scan1/points_mvsnet/cams/ -images_folder exps/dtu_test/scan1/points_mvsnet/images/ --depth_min=0.001 --depth_max=100000 --normal_thresh=360 --disp_thresh=0.1 --num_consistent=2.0 -color_processing Command-line parameter error: unknown option -input_folder input folder is exps/dtu_test/scan1/points_mvsnet/ image folder is exps/dtu_test/scan1/points_mvsnet/images/ p folder is exps/dtu_test/scan1/points_mvsnet/cams/ pmvs folder is numImages is 49 img_filenames is 49 Device memory used: 954.728455MB Device memory used: 954.728455MB P folder is exps/dtu_test/scan1/points_mvsnet/cams/ numCameras is 49 Camera size is 49 Accepted intersection angle of central rays is 10.000000 to 30.000000 degrees Selected views: 49 0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, Reading normals and depth from disk Size consideredIds is 49 [ WARN:0@5.417] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000000.png'): can't open/read file: check file path/integrity Reading normal 0 Reading disp 0 [ WARN:0@5.478] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000001.png'): can't open/read file: check file path/integrity Reading normal 1 Reading disp 1 [ WARN:0@5.545] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000002.png'): can't open/read file: check file path/integrity Reading normal 2 Reading disp 2 [ WARN:0@5.606] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000003.png'): can't open/read file: check file path/integrity Reading normal 3 Reading disp 3 [ WARN:0@5.668] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000004.png'): can't open/read file: check file path/integrity Reading normal 4 Reading disp 4 [ WARN:0@5.729] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000005.png'): can't open/read file: check file path/integrity Reading normal 5 Reading disp 5 [ WARN:0@5.787] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000006.png'): can't open/read file: check file path/integrity Reading normal 6 Reading disp 6 [ WARN:0@5.839] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000007.png'): can't open/read file: check file path/integrity Reading normal 7 Reading disp 7 [ WARN:0@5.884] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000008.png'): can't open/read file: check file path/integrity Reading normal 8 Reading disp 8 [ WARN:0@5.929] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000009.png'): can't open/read file: check file path/integrity Reading normal 9 Reading disp 9 [ WARN:0@5.976] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000010.png'): can't open/read file: check file path/integrity Reading normal 10 Reading disp 10 [ WARN:0@6.020] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000011.png'): can't open/read file: check file path/integrity Reading normal 11 Reading disp 11 [ WARN:0@6.070] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000012.png'): can't open/read file: check file path/integrity Reading normal 12 Reading disp 12 [ WARN:0@6.125] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000013.png'): can't open/read file: check file path/integrity Reading normal 13 Reading disp 13 [ WARN:0@6.178] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000014.png'): can't open/read file: check file path/integrity Reading normal 14 Reading disp 14 [ WARN:0@6.231] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000015.png'): can't open/read file: check file path/integrity Reading normal 15 Reading disp 15 [ WARN:0@6.282] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000016.png'): can't open/read file: check file path/integrity Reading normal 16 Reading disp 16 [ WARN:0@6.336] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000017.png'): can't open/read file: check file path/integrity Reading normal 17 Reading disp 17 [ WARN:0@6.391] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000018.png'): can't open/read file: check file path/integrity Reading normal 18 Reading disp 18 [ WARN:0@6.445] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000019.png'): can't open/read file: check file path/integrity Reading normal 19 Reading disp 19 [ WARN:0@6.498] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000020.png'): can't open/read file: check file path/integrity Reading normal 20 Reading disp 20 [ WARN:0@6.549] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000021.png'): can't open/read file: check file path/integrity Reading normal 21 Reading disp 21 [ WARN:0@6.598] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000022.png'): can't open/read file: check file path/integrity Reading normal 22 Reading disp 22 [ WARN:0@6.646] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000023.png'): can't open/read file: check file path/integrity Reading normal 23 Reading disp 23 [ WARN:0@6.693] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000024.png'): can't open/read file: check file path/integrity Reading normal 24 Reading disp 24 [ WARN:0@6.739] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000025.png'): can't open/read file: check file path/integrity Reading normal 25 Reading disp 25 [ WARN:0@6.784] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000026.png'): can't open/read file: check file path/integrity Reading normal 26 Reading disp 26 [ WARN:0@6.838] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000027.png'): can't open/read file: check file path/integrity Reading normal 27 Reading disp 27 [ WARN:0@6.891] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000028.png'): can't open/read file: check file path/integrity Reading normal 28 Reading disp 28 [ WARN:0@6.950] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000029.png'): can't open/read file: check file path/integrity Reading normal 29 Reading disp 29 [ WARN:0@7.008] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000030.png'): can't open/read file: check file path/integrity Reading normal 30 Reading disp 30 [ WARN:0@7.064] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000031.png'): can't open/read file: check file path/integrity Reading normal 31 Reading disp 31 [ WARN:0@7.121] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000032.png'): can't open/read file: check file path/integrity Reading normal 32 Reading disp 32 [ WARN:0@7.178] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000033.png'): can't open/read file: check file path/integrity Reading normal 33 Reading disp 33 [ WARN:0@7.242] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000034.png'): can't open/read file: check file path/integrity Reading normal 34 Reading disp 34 [ WARN:0@7.298] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000035.png'): can't open/read file: check file path/integrity Reading normal 35 Reading disp 35 [ WARN:0@7.355] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000036.png'): can't open/read file: check file path/integrity Reading normal 36 Reading disp 36 [ WARN:0@7.415] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000037.png'): can't open/read file: check file path/integrity Reading normal 37 Reading disp 37 [ WARN:0@7.472] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000038.png'): can't open/read file: check file path/integrity Reading normal 38 Reading disp 38 [ WARN:0@7.529] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000039.png'): can't open/read file: check file path/integrity Reading normal 39 Reading disp 39 [ WARN:0@7.587] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000040.png'): can't open/read file: check file path/integrity Reading normal 40 Reading disp 40 [ WARN:0@7.647] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000041.png'): can't open/read file: check file path/integrity Reading normal 41 Reading disp 41 [ WARN:0@7.700] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000042.png'): can't open/read file: check file path/integrity Reading normal 42 Reading disp 42 [ WARN:0@7.752] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000043.png'): can't open/read file: check file path/integrity Reading normal 43 Reading disp 43 [ WARN:0@7.803] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000044.png'): can't open/read file: check file path/integrity Reading normal 44 Reading disp 44 [ WARN:0@7.859] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000045.png'): can't open/read file: check file path/integrity Reading normal 45 Reading disp 45 [ WARN:0@7.913] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000046.png'): can't open/read file: check file path/integrity Reading normal 46 Reading disp 46 [ WARN:0@7.964] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000047.png'): can't open/read file: check file path/integrity Reading normal 47 Reading disp 47 [ WARN:0@8.014] global /home/conda/feedstock_root/build_artifacts/libopencv1658893721168/work/modules/imgcodecs/src/loadsave.cpp (239) findDecoder imread('exps/dtu_test/scan1/points_mvsnet/images/00000048.png'): can't open/read file: check file path/integrity Reading normal 48 Reading disp 48 Resizing globalstate to 49 Run cuda Run gipuma Grid size initrand is grid: 48-36 block: 32-32 Device memory used: 3729.260498MB Number of iterations is 8 Blocksize is 15x15 Disparity threshold is 0.100000 Normal threshold is 6.283185 Number of consistent points is 2 Cam scale is 1.000000 Fusing points Processing camera 0 Found 0.00 million points Processing camera 1 Found 0.00 million points Processing camera 2 Found 0.00 million points Processing camera 3 Found 0.00 million points Processing camera 4 Found 0.00 million points Processing camera 5 Found 0.00 million points Processing camera 6 Found 0.00 million points Processing camera 7 Found 0.00 million points Processing camera 8 Found 0.00 million points Processing camera 9 Found 0.00 million points Processing camera 10 Found 0.00 million points Processing camera 11 Found 0.00 million points Processing camera 12 Found 0.00 million points Processing camera 13 Found 0.00 million points Processing camera 14 Found 0.00 million points Processing camera 15 Found 0.00 million points Processing camera 16 Found 0.00 million points Processing camera 17 Found 0.00 million points Processing camera 18 Found 0.00 million points Processing camera 19 Found 0.00 million points Processing camera 20 Found 0.00 million points Processing camera 21 Found 0.00 million points Processing camera 22 Found 0.00 million points Processing camera 23 Found 0.00 million points Processing camera 24 Found 0.00 million points Processing camera 25 Found 0.00 million points Processing camera 26 Found 0.00 million points Processing camera 27 Found 0.00 million points Processing camera 28 Found 0.00 million points Processing camera 29 Found 0.00 million points Processing camera 30 Found 0.00 million points Processing camera 31 Found 0.00 million points Processing camera 32 Found 0.00 million points Processing camera 33 Found 0.00 million points Processing camera 34 Found 0.00 million points Processing camera 35 Found 0.00 million points Processing camera 36 Found 0.00 million points Processing camera 37 Found 0.00 million points Processing camera 38 Found 0.00 million points Processing camera 39 Found 0.00 million points Processing camera 40 Found 0.00 million points Processing camera 41 Found 0.00 million points Processing camera 42 Found 0.00 million points Processing camera 43 Found 0.00 million points Processing camera 44 Found 0.00 million points Processing camera 45 Found 0.00 million points Processing camera 46 Found 0.00 million points Processing camera 47 Found 0.00 million points Processing camera 48 Found 0.00 million points ELAPSED 1.082505 seconds Error: no kernel image is available for execution on the device Writing ply file exps/dtu_test/scan1/points_mvsnet//consistencyCheck-20240228-171216//final3d_model.ply store 3D points to ply file

BoiMat commented 4 months ago

Solved by compiling fusibile with the right CUDA_NVCC_FLAGS in CMakeLists.txt according to the gpu device used.