search

mapillary / OpenSfM

Open source Structure-from-Motion pipeline
https://www.opensfm.org/
BSD 2-Clause "Simplified" License
3.39k stars 859 forks source link

Issues about the input data type #587

Open Juuustin opened 4 years ago

Juuustin commented 4 years ago

Is it possible to use video frames to create a 3d model? I tried to use 10 frames from a video, but there is no output.

mlopezantequera commented 4 years ago

It is possible, as long as the frames have enough overlap

Juuustin commented 4 years ago

It is possible, as long as the frames have enough overlap

Great! what is the minimum requirement for the overlap?

mlopezantequera commented 4 years ago

There's no clear answer for that. There must be enough overlap of textured surfaces such that the images can be registered together. Try extracting frames at a higher framerate

Juuustin commented 4 years ago

There's no clear answer for that. There must be enough overlap of textured surfaces such that the images can be registered together. Try extracting frames at a higher framerate

My frames have about 90% overlap, and after running there is an error: FileNotFoundError: [Errno 2] No such file or directory: 'data/0389_small/undistorted/reconstruction.json' When I open the .json file through viewer, it is empty

mlopezantequera commented 4 years ago

This is probably unrelated to the nature of your images then. Can you share the exact commands that you use to reconstruct and to open the viewer?

Juuustin commented 4 years ago

This is probably unrelated to the nature of your images then. Can you share the exact commands that you use to reconstruct and to open the viewer? This is the command to use viewer: python -m http.server

This is the command to reconstruct: bin/opensfm_run_all data/0389_small

This is the output: Running using Python command: python3 2020-04-21 16:41:18,995 INFO: Loading existing EXIF for frame0953500076.jpg 2020-04-21 16:41:18,996 INFO: Loading existing EXIF for frame0953490542.jpg 2020-04-21 16:41:18,996 INFO: Loading existing EXIF for frame0953510410.jpg 2020-04-21 16:41:18,996 INFO: Loading existing EXIF for frame0953510944.jpg 2020-04-21 16:41:18,996 INFO: Loading existing EXIF for frame0953510144.jpg 2020-04-21 16:41:18,997 INFO: Loading existing EXIF for frame0953500877.jpg 2020-04-21 16:41:18,997 INFO: Loading existing EXIF for frame0953500343.jpg 2020-04-21 16:41:18,997 INFO: Loading existing EXIF for frame0953490275.jpg 2020-04-21 16:41:18,998 INFO: Loading existing EXIF for frame0953510677.jpg 2020-04-21 16:41:18,998 INFO: Loading existing EXIF for frame0953490809.jpg 2020-04-21 16:41:20,003 INFO: Skip recomputing ROOT_HAHOG features for image frame0953490542.jpg 2020-04-21 16:41:20,020 INFO: Skip recomputing ROOT_HAHOG features for image frame0953510677.jpg 2020-04-21 16:41:20,021 INFO: Skip recomputing ROOT_HAHOG features for image frame0953490809.jpg 2020-04-21 16:41:20,080 INFO: Skip recomputing ROOT_HAHOG features for image frame0953510410.jpg 2020-04-21 16:41:20,089 INFO: Skip recomputing ROOT_HAHOG features for image frame0953500076.jpg 2020-04-21 16:41:20,090 INFO: Skip recomputing ROOT_HAHOG features for image frame0953510944.jpg 2020-04-21 16:41:20,116 INFO: Skip recomputing ROOT_HAHOG features for image frame0953510144.jpg 2020-04-21 16:41:20,183 INFO: Skip recomputing ROOT_HAHOG features for image frame0953500877.jpg 2020-04-21 16:41:20,207 INFO: Skip recomputing ROOT_HAHOG features for image frame0953500343.jpg 2020-04-21 16:41:20,213 INFO: Skip recomputing ROOT_HAHOG features for image frame0953490275.jpg 2020-04-21 16:41:20,862 INFO: Matching 55 image pairs 2020-04-21 16:41:20,866 INFO: Computing pair matching with 8 processes 2020-04-21 16:41:21,357 DEBUG: No segmentation for frame0953510944.jpg, no features masked. 2020-04-21 16:41:21,358 DEBUG: No segmentation for frame0953490542.jpg, no features masked. 2020-04-21 16:41:21,369 DEBUG: No segmentation for frame0953490542.jpg, no features masked. 2020-04-21 16:41:21,371 DEBUG: No segmentation for frame0953490809.jpg, no features masked. 2020-04-21 16:41:21,384 DEBUG: No segmentation for frame0953490809.jpg, no features masked. 2020-04-21 16:41:21,386 DEBUG: No segmentation for frame0953500877.jpg, no features masked. 2020-04-21 16:41:21,406 DEBUG: No segmentation for frame0953510677.jpg, no features masked. 2020-04-21 16:41:21,408 DEBUG: No segmentation for frame0953490809.jpg, no features masked. 2020-04-21 16:41:21,430 DEBUG: No segmentation for frame0953510144.jpg, no features masked. 2020-04-21 16:41:21,519 DEBUG: No segmentation for frame0953500877.jpg, no features masked. 2020-04-21 16:41:21,521 DEBUG: No segmentation for frame0953500343.jpg, no features masked. 2020-04-21 16:41:21,531 DEBUG: No segmentation for frame0953500076.jpg, no features masked. 2020-04-21 16:41:21,533 DEBUG: No segmentation for frame0953500343.jpg, no features masked. 2020-04-21 16:41:21,628 DEBUG: No segmentation for frame0953500343.jpg, no features masked. 2020-04-21 16:41:21,633 DEBUG: No segmentation for frame0953510410.jpg, no features masked. 2020-04-21 16:41:22,031 DEBUG: Matching frame0953510144.jpg and frame0953510144.jpg. Matcher: FLANN (symmetric) T-desc: 0.601 T-robust: 0.001 T-total: 0.602 Matches: 4705 Robust: 0 Success: False 2020-04-21 16:41:22,041 DEBUG: No segmentation for frame0953500343.jpg, no features masked. 2020-04-21 16:41:22,216 DEBUG: Matching frame0953490542.jpg and frame0953490809.jpg. Matcher: FLANN (symmetric) T-desc: 0.841 T-robust: 0.004 T-total: 0.845 Matches: 2310 Robust: 2295 Success: True 2020-04-21 16:41:22,224 DEBUG: Matching frame0953510944.jpg and frame0953490542.jpg. Matcher: FLANN (symmetric) T-desc: 0.859 T-robust: 0.005 T-total: 0.864 Matches: 1730 Robust: 1719 Success: True 2020-04-21 16:41:22,225 DEBUG: No segmentation for frame0953500877.jpg, no features masked. 2020-04-21 16:41:22,236 DEBUG: No segmentation for frame0953510144.jpg, no features masked. 2020-04-21 16:41:22,296 DEBUG: Matching frame0953510677.jpg and frame0953490809.jpg. Matcher: FLANN (symmetric) T-desc: 0.875 T-robust: 0.009 T-total: 0.884 Matches: 1510 Robust: 1486 Success: True 2020-04-21 16:41:22,312 DEBUG: No segmentation for frame0953510944.jpg, no features masked. 2020-04-21 16:41:22,368 DEBUG: Matching frame0953500076.jpg and frame0953500343.jpg. Matcher: FLANN (symmetric) T-desc: 0.826 T-robust: 0.007 T-total: 0.833 Matches: 2381 Robust: 2367 Success: True 2020-04-21 16:41:22,379 DEBUG: Matching frame0953490809.jpg and frame0953500877.jpg. Matcher: FLANN (symmetric) T-desc: 0.979 T-robust: 0.010 T-total: 0.989 Matches: 1845 Robust: 1827 Success: True 2020-04-21 16:41:22,380 DEBUG: No segmentation for frame0953510410.jpg, no features masked. 2020-04-21 16:41:22,402 DEBUG: No segmentation for frame0953510410.jpg, no features masked. 2020-04-21 16:41:22,447 DEBUG: Matching frame0953500343.jpg and frame0953510410.jpg. Matcher: FLANN (symmetric) T-desc: 0.813 T-robust: 0.003 T-total: 0.817 Matches: 1118 Robust: 1070 Success: True 2020-04-21 16:41:22,459 DEBUG: No segmentation for frame0953490275.jpg, no features masked. 2020-04-21 16:41:22,468 DEBUG: Matching frame0953510144.jpg and frame0953500343.jpg. Matcher: FLANN (symmetric) T-desc: 0.422 T-robust: 0.004 T-total: 0.425 Matches: 1414 Robust: 1357 Success: True 2020-04-21 16:41:22,491 DEBUG: No segmentation for frame0953500076.jpg, no features masked. 2020-04-21 16:41:22,512 DEBUG: Matching frame0953500877.jpg and frame0953500343.jpg. Matcher: FLANN (symmetric) T-desc: 0.979 T-robust: 0.005 T-total: 0.984 Matches: 1939 Robust: 1924 Success: True 2020-04-21 16:41:22,536 DEBUG: No segmentation for frame0953510144.jpg, no features masked. 2020-04-21 16:41:22,721 DEBUG: Matching frame0953490542.jpg and frame0953500877.jpg. Matcher: FLANN (symmetric) T-desc: 0.490 T-robust: 0.004 T-total: 0.494 Matches: 1602 Robust: 1576 Success: True 2020-04-21 16:41:22,733 DEBUG: Matching frame0953510944.jpg and frame0953510144.jpg. Matcher: FLANN (symmetric) T-desc: 0.490 T-robust: 0.005 T-total: 0.495 Matches: 1726 Robust: 1716 Success: True 2020-04-21 16:41:22,743 DEBUG: No segmentation for frame0953490809.jpg, no features masked. 2020-04-21 16:41:22,789 DEBUG: Matching frame0953510677.jpg and frame0953510944.jpg. Matcher: FLANN (symmetric) T-desc: 0.467 T-robust: 0.007 T-total: 0.474 Matches: 2926 Robust: 2918 Success: True 2020-04-21 16:41:22,799 DEBUG: No segmentation for frame0953500877.jpg, no features masked. 2020-04-21 16:41:22,912 DEBUG: Matching frame0953500076.jpg and frame0953510410.jpg. Matcher: FLANN (symmetric) T-desc: 0.529 T-robust: 0.003 T-total: 0.532 Matches: 1268 Robust: 1189 Success: True 2020-04-21 16:41:22,915 DEBUG: Matching frame0953490809.jpg and frame0953510410.jpg. Matcher: FLANN (symmetric) T-desc: 0.509 T-robust: 0.004 T-total: 0.513 Matches: 1549 Robust: 1505 Success: True 2020-04-21 16:41:22,922 DEBUG: No segmentation for frame0953490275.jpg, no features masked. 2020-04-21 16:41:22,925 DEBUG: No segmentation for frame0953500343.jpg, no features masked. 2020-04-21 16:41:22,953 DEBUG: Matching frame0953490542.jpg and frame0953490542.jpg. Matcher: FLANN (symmetric) T-desc: 0.230 T-robust: 0.001 T-total: 0.231 Matches: 4712 Robust: 0 Success: False 2020-04-21 16:41:22,962 DEBUG: No segmentation for frame0953490275.jpg, no features masked. 2020-04-21 16:41:23,044 DEBUG: Matching frame0953500343.jpg and frame0953490275.jpg. Matcher: FLANN (symmetric) T-desc: 0.576 T-robust: 0.005 T-total: 0.581 Matches: 1335 Robust: 1311 Success: True 2020-04-21 16:41:23,055 DEBUG: Matching frame0953500877.jpg and frame0953510144.jpg. Matcher: FLANN (symmetric) T-desc: 0.511 T-robust: 0.005 T-total: 0.517 Matches: 1980 Robust: 1965 Success: True 2020-04-21 16:41:23,066 DEBUG: No segmentation for frame0953500076.jpg, no features masked. 2020-04-21 16:41:23,094 DEBUG: Matching frame0953510144.jpg and frame0953500076.jpg. Matcher: FLANN (symmetric) T-desc: 0.598 T-robust: 0.005 T-total: 0.603 Matches: 1500 Robust: 1468 Success: True 2020-04-21 16:41:23,110 DEBUG: No segmentation for frame0953510410.jpg, no features masked. 2020-04-21 16:41:23,248 DEBUG: Matching frame0953510944.jpg and frame0953490809.jpg. Matcher: FLANN (symmetric) T-desc: 0.500 T-robust: 0.004 T-total: 0.504 Matches: 1456 Robust: 1427 Success: True 2020-04-21 16:41:23,258 DEBUG: No segmentation for frame0953500343.jpg, no features masked. 2020-04-21 16:41:23,346 DEBUG: Matching frame0953500343.jpg and frame0953500343.jpg. Matcher: FLANN (symmetric) T-desc: 0.300 T-robust: 0.001 T-total: 0.301 Matches: 4775 Robust: 0 Success: False 2020-04-21 16:41:23,346 DEBUG: Image frame0953500343.jpg matches: 2 out of 3 2020-04-21 16:41:23,369 DEBUG: Matching frame0953500076.jpg and frame0953490275.jpg. Matcher: FLANN (symmetric) T-desc: 0.441 T-robust: 0.004 T-total: 0.445 Matches: 1479 Robust: 1406 Success: True 2020-04-21 16:41:23,376 DEBUG: Matching frame0953510677.jpg and frame0953500877.jpg. Matcher: FLANN (symmetric) T-desc: 0.573 T-robust: 0.004 T-total: 0.576 Matches: 1328 Robust: 1268 Success: True 2020-04-21 16:41:23,386 DEBUG: No segmentation for frame0953510410.jpg, no features masked. 2020-04-21 16:41:23,401 DEBUG: Matching frame0953490809.jpg and frame0953500343.jpg. Matcher: FLANN (symmetric) T-desc: 0.470 T-robust: 0.004 T-total: 0.474 Matches: 1599 Robust: 1588 Success: True 2020-04-21 16:41:23,412 DEBUG: No segmentation for frame0953490275.jpg, no features masked. 2020-04-21 16:41:23,482 DEBUG: Matching frame0953500877.jpg and frame0953500076.jpg. Matcher: FLANN (symmetric) T-desc: 0.408 T-robust: 0.006 T-total: 0.414 Matches: 2231 Robust: 2215 Success: True 2020-04-21 16:41:23,483 DEBUG: Matching frame0953490542.jpg and frame0953490275.jpg. Matcher: FLANN (symmetric) T-desc: 0.507 T-robust: 0.008 T-total: 0.515 Matches: 2951 Robust: 2945 Success: True 2020-04-21 16:41:23,493 DEBUG: No segmentation for frame0953510410.jpg, no features masked. 2020-04-21 16:41:23,575 DEBUG: Matching frame0953510144.jpg and frame0953510410.jpg. Matcher: FLANN (symmetric) T-desc: 0.446 T-robust: 0.005 T-total: 0.451 Matches: 2128 Robust: 2119 Success: True 2020-04-21 16:41:23,592 DEBUG: No segmentation for frame0953490275.jpg, no features masked. 2020-04-21 16:41:23,603 DEBUG: Matching frame0953490275.jpg and frame0953510410.jpg. Matcher: FLANN (symmetric) T-desc: 0.226 T-robust: 0.005 T-total: 0.231 Matches: 1914 Robust: 1898 Success: True 2020-04-21 16:41:23,657 DEBUG: Matching frame0953510944.jpg and frame0953500343.jpg. Matcher: FLANN (symmetric) T-desc: 0.395 T-robust: 0.003 T-total: 0.398 Matches: 1057 Robust: 1047 Success: True 2020-04-21 16:41:23,657 DEBUG: Matching frame0953500076.jpg and frame0953500076.jpg. Matcher: FLANN (symmetric) T-desc: 0.287 T-robust: 0.001 T-total: 0.288 Matches: 4783 Robust: 0 Success: False 2020-04-21 16:41:23,657 DEBUG: Image frame0953500076.jpg matches: 3 out of 4 2020-04-21 16:41:23,666 DEBUG: No segmentation for frame0953510410.jpg, no features masked. 2020-04-21 16:41:23,753 DEBUG: Matching frame0953500877.jpg and frame0953500877.jpg. Matcher: FLANN (symmetric) T-desc: 0.269 T-robust: 0.001 T-total: 0.270 Matches: 4753 Robust: 0 Success: False 2020-04-21 16:41:23,765 DEBUG: No segmentation for frame0953510410.jpg, no features masked. 2020-04-21 16:41:23,817 DEBUG: Matching frame0953510677.jpg and frame0953510410.jpg. Matcher: FLANN (symmetric) T-desc: 0.420 T-robust: 0.007 T-total: 0.427 Matches: 2521 Robust: 2494 Success: True 2020-04-21 16:41:23,826 DEBUG: No segmentation for frame0953510144.jpg, no features masked. 2020-04-21 16:41:23,833 DEBUG: Matching frame0953490275.jpg and frame0953490275.jpg. Matcher: FLANN (symmetric) T-desc: 0.229 T-robust: 0.001 T-total: 0.230 Matches: 4722 Robust: 0 Success: False 2020-04-21 16:41:23,833 DEBUG: Image frame0953490275.jpg matches: 1 out of 2 2020-04-21 16:41:23,917 DEBUG: Matching frame0953490809.jpg and frame0953490275.jpg. Matcher: FLANN (symmetric) T-desc: 0.498 T-robust: 0.004 T-total: 0.503 Matches: 2099 Robust: 2075 Success: True 2020-04-21 16:41:23,926 DEBUG: No segmentation for frame0953500076.jpg, no features masked. 2020-04-21 16:41:23,927 DEBUG: Matching frame0953490542.jpg and frame0953510410.jpg. Matcher: FLANN (symmetric) T-desc: 0.427 T-robust: 0.005 T-total: 0.432 Matches: 1867 Robust: 1850 Success: True 2020-04-21 16:41:23,935 DEBUG: No segmentation for frame0953510144.jpg, no features masked. 2020-04-21 16:41:23,948 DEBUG: Matching frame0953510410.jpg and frame0953510410.jpg. Matcher: FLANN (symmetric) T-desc: 0.265 T-robust: 0.001 T-total: 0.266 Matches: 4747 Robust: 0 Success: False 2020-04-21 16:41:23,948 DEBUG: Image frame0953510410.jpg matches: 0 out of 1 2020-04-21 16:41:24,143 DEBUG: Matching frame0953510144.jpg and frame0953490275.jpg. Matcher: FLANN (symmetric) T-desc: 0.542 T-robust: 0.006 T-total: 0.548 Matches: 2322 Robust: 2271 Success: True 2020-04-21 16:41:24,143 DEBUG: Image frame0953510144.jpg matches: 4 out of 5 2020-04-21 16:41:24,145 DEBUG: Matching frame0953510944.jpg and frame0953510410.jpg. Matcher: FLANN (symmetric) T-desc: 0.473 T-robust: 0.005 T-total: 0.478 Matches: 2362 Robust: 2348 Success: True 2020-04-21 16:41:24,153 DEBUG: No segmentation for frame0953500076.jpg, no features masked. 2020-04-21 16:41:24,261 DEBUG: Matching frame0953500877.jpg and frame0953510410.jpg. Matcher: FLANN (symmetric) T-desc: 0.492 T-robust: 0.003 T-total: 0.495 Matches: 1505 Robust: 1439 Success: True 2020-04-21 16:41:24,270 DEBUG: No segmentation for frame0953490275.jpg, no features masked. 2020-04-21 16:41:24,282 DEBUG: Matching frame0953510677.jpg and frame0953510144.jpg. Matcher: FLANN (symmetric) T-desc: 0.450 T-robust: 0.005 T-total: 0.454 Matches: 1886 Robust: 1862 Success: True 2020-04-21 16:41:24,291 DEBUG: No segmentation for frame0953500343.jpg, no features masked. 2020-04-21 16:41:24,304 DEBUG: Matching frame0953490542.jpg and frame0953510144.jpg. Matcher: FLANN (symmetric) T-desc: 0.361 T-robust: 0.005 T-total: 0.366 Matches: 2332 Robust: 2316 Success: True 2020-04-21 16:41:24,312 DEBUG: No segmentation for frame0953500076.jpg, no features masked. 2020-04-21 16:41:24,347 DEBUG: Matching frame0953490809.jpg and frame0953500076.jpg. Matcher: FLANN (symmetric) T-desc: 0.415 T-robust: 0.005 T-total: 0.419 Matches: 1912 Robust: 1894 Success: True 2020-04-21 16:41:24,358 DEBUG: No segmentation for frame0953510144.jpg, no features masked. 2020-04-21 16:41:24,529 DEBUG: Matching frame0953510944.jpg and frame0953500076.jpg. Matcher: FLANN (symmetric) T-desc: 0.372 T-robust: 0.003 T-total: 0.376 Matches: 1105 Robust: 1057 Success: True 2020-04-21 16:41:24,540 DEBUG: No segmentation for frame0953500877.jpg, no features masked. 2020-04-21 16:41:24,677 DEBUG: Matching frame0953500877.jpg and frame0953490275.jpg. Matcher: FLANN (symmetric) T-desc: 0.405 T-robust: 0.002 T-total: 0.407 Matches: 1606 Robust: 1591 Success: True 2020-04-21 16:41:24,677 DEBUG: Image frame0953500877.jpg matches: 5 out of 6 2020-04-21 16:41:24,685 DEBUG: Matching frame0953510677.jpg and frame0953500343.jpg. Matcher: FLANN (symmetric) T-desc: 0.392 T-robust: 0.002 T-total: 0.394 Matches: 1087 Robust: 1063 Success: True 2020-04-21 16:41:24,692 DEBUG: No segmentation for frame0953490275.jpg, no features masked. 2020-04-21 16:41:24,694 DEBUG: Matching frame0953490809.jpg and frame0953510144.jpg. Matcher: FLANN (symmetric) T-desc: 0.332 T-robust: 0.003 T-total: 0.335 Matches: 2044 Robust: 2020 Success: True 2020-04-21 16:41:24,704 DEBUG: Matching frame0953490542.jpg and frame0953500076.jpg. Matcher: FLANN (symmetric) T-desc: 0.387 T-robust: 0.002 T-total: 0.389 Matches: 1542 Robust: 1527 Success: True 2020-04-21 16:41:24,713 DEBUG: No segmentation for frame0953500343.jpg, no features masked. 2020-04-21 16:41:24,852 DEBUG: Matching frame0953510944.jpg and frame0953500877.jpg. Matcher: FLANN (symmetric) T-desc: 0.311 T-robust: 0.002 T-total: 0.312 Matches: 1227 Robust: 1200 Success: True 2020-04-21 16:41:24,888 DEBUG: Matching frame0953490809.jpg and frame0953490809.jpg. Matcher: FLANN (symmetric) T-desc: 0.194 T-robust: 0.000 T-total: 0.194 Matches: 4770 Robust: 0 Success: False 2020-04-21 16:41:24,888 DEBUG: Image frame0953490809.jpg matches: 6 out of 7 2020-04-21 16:41:24,969 DEBUG: Matching frame0953510677.jpg and frame0953490275.jpg. Matcher: FLANN (symmetric) T-desc: 0.273 T-robust: 0.003 T-total: 0.275 Matches: 1804 Robust: 1792 Success: True 2020-04-21 16:41:24,976 DEBUG: No segmentation for frame0953490542.jpg, no features masked. 2020-04-21 16:41:24,982 DEBUG: Matching frame0953490542.jpg and frame0953500343.jpg. Matcher: FLANN (symmetric) T-desc: 0.266 T-robust: 0.002 T-total: 0.268 Matches: 1371 Robust: 1356 Success: True 2020-04-21 16:41:24,983 DEBUG: Image frame0953490542.jpg matches: 7 out of 8 2020-04-21 16:41:25,025 DEBUG: Matching frame0953510944.jpg and frame0953510944.jpg. Matcher: FLANN (symmetric) T-desc: 0.173 T-robust: 0.001 T-total: 0.173 Matches: 4749 Robust: 0 Success: False 2020-04-21 16:41:25,034 DEBUG: No segmentation for frame0953490275.jpg, no features masked. 2020-04-21 16:41:25,213 DEBUG: Matching frame0953510677.jpg and frame0953490542.jpg. Matcher: FLANN (symmetric) T-desc: 0.234 T-robust: 0.002 T-total: 0.237 Matches: 1792 Robust: 1775 Success: True 2020-04-21 16:41:25,221 DEBUG: No segmentation for frame0953500076.jpg, no features masked. 2020-04-21 16:41:25,254 DEBUG: Matching frame0953510944.jpg and frame0953490275.jpg. Matcher: FLANN (symmetric) T-desc: 0.214 T-robust: 0.004 T-total: 0.218 Matches: 1765 Robust: 1753 Success: True 2020-04-21 16:41:25,254 DEBUG: Image frame0953510944.jpg matches: 8 out of 9 2020-04-21 16:41:25,435 DEBUG: Matching frame0953510677.jpg and frame0953500076.jpg. Matcher: FLANN (symmetric) T-desc: 0.213 T-robust: 0.002 T-total: 0.214 Matches: 1172 Robust: 1154 Success: True 2020-04-21 16:41:25,576 DEBUG: Matching frame0953510677.jpg and frame0953510677.jpg. Matcher: FLANN (symmetric) T-desc: 0.140 T-robust: 0.000 T-total: 0.141 Matches: 4769 Robust: 0 Success: False 2020-04-21 16:41:25,576 DEBUG: Image frame0953510677.jpg matches: 9 out of 10 2020-04-21 16:41:25,579 INFO: Matched 55 pairs for 10 ref_images (perspective-perspective: 55) in 4.716653084848076 seconds (0.08575734336098487 seconds/pair). 2020-04-21 16:41:27,099 INFO: reading features 2020-04-21 16:41:27,176 DEBUG: Merging features onto tracks 2020-04-21 16:41:27,514 DEBUG: Good tracks: 8730 2020-04-21 16:41:28,713 INFO: Starting incremental reconstruction 2020-04-21 16:41:29,536 INFO: 0 partial reconstructions in total. Traceback (most recent call last): File "/home/objloc/OBJLOC/OpenSfM/bin/opensfm", line 34, in <module> command.run(args) File "/home/objloc/OBJLOC/OpenSfM/opensfm/commands/compute_depthmaps.py", line 33, in run reconstructions = udata.load_undistorted_reconstruction() File "/home/objloc/OBJLOC/OpenSfM/opensfm/dataset.py", line 771, in load_undistorted_reconstruction filename=os.path.join(self.subfolder, 'reconstruction.json')) File "/home/objloc/OBJLOC/OpenSfM/opensfm/dataset.py", line 391, in load_reconstruction with io.open_rt(self._reconstruction_file(filename)) as fin: File "/home/objloc/OBJLOC/OpenSfM/opensfm/io.py", line 546, in open_rt return io.open(path, 'r', encoding='utf-8') FileNotFoundError: [Errno 2] No such file or directory: 'data/0389_small/undistorted/reconstruction.json

moopene36607 commented 4 years ago

INFO: 0 partial reconstructions in total. Seems like the reconstruction step didn't predict any result. Not sure if it helps, but you could try to use more frames with higher fps (e.g. 50 frames and 2.5 fps) and set matching_order_neighbors: 7 and feature_min_frames: 7000 in _data/0389small/config.yaml.

Juuustin commented 4 years ago

INFO: 0 partial reconstructions in total. Seems like the reconstruction step didn't predict any result. Not sure if it helps, but you could try to use more frames with higher fps (e.g. 50 frames and 2.5 fps) and set matching_order_neighbors: 7 and feature_min_frames: 7000 in _data/0389small/config.yaml.

Hi, thank you for your advice, and didn't downsample the frame this time, that is 30 fps and 87 frames in total, also I tried the parameters advised in config.yaml, and this is the output:

2020-04-24 11:20:36,055 DEBUG: Matching frame0953510210.jpg and frame0953510077.jpg. Matcher: FLANN (symmetric) T-desc: 0.842 T-robust: 0.010 T-total: 0.852 Matches: 5399 Robust: 5394 Success: True 2020-04-24 11:20:36,055 DEBUG: Image frame0953510210.jpg matches: 1 out of 1 2020-04-24 11:20:36,283 DEBUG: Image frame0953490275.jpg matches: 0 out of 0 2020-04-24 11:20:36,308 DEBUG: Image frame0953500176.jpg matches: 0 out of 0 2020-04-24 11:20:36,335 DEBUG: Image frame0953510077.jpg matches: 0 out of 0 2020-04-24 11:20:36,351 DEBUG: Image frame0953490475.jpg matches: 0 out of 0 2020-04-24 11:20:36,367 DEBUG: Image frame0953510511.jpg matches: 0 out of 0 2020-04-24 11:20:36,377 DEBUG: Image frame0953520044.jpg matches: 0 out of 0 2020-04-24 11:20:36,485 DEBUG: Matching frame0953510844.jpg and frame0953510711.jpg. Matcher: FLANN (symmetric) T-desc: 0.696 T-robust: 0.008 T-total: 0.704 Matches: 6018 Robust: 6016 Success: True 2020-04-24 11:20:36,485 DEBUG: Image frame0953510844.jpg matches: 1 out of 1 2020-04-24 11:20:36,569 DEBUG: Image frame0953490876.jpg matches: 0 out of 0 2020-04-24 11:20:36,571 INFO: Matched 338 pairs for 87 ref_images (perspective-perspective: 338) in 62.810014562215656 seconds (0.18582844794672754 seconds/pair). 2020-04-24 11:21:04,903 INFO: reading features 2020-04-24 11:21:05,866 DEBUG: Merging features onto tracks 2020-04-24 11:21:15,646 DEBUG: Good tracks: 62450 2020-04-24 11:21:42,115 INFO: Starting incremental reconstruction 2020-04-24 11:22:17,876 INFO: 0 partial reconstructions in total. Traceback (most recent call last): File "/home/objloc/OBJLOC/OpenSfM/bin/opensfm", line 34, in <module> command.run(args) File "/home/objloc/OBJLOC/OpenSfM/opensfm/commands/compute_depthmaps.py", line 33, in run reconstructions = udata.load_undistorted_reconstruction() File "/home/objloc/OBJLOC/OpenSfM/opensfm/dataset.py", line 771, in load_undistorted_reconstruction filename=os.path.join(self.subfolder, 'reconstruction.json')) File "/home/objloc/OBJLOC/OpenSfM/opensfm/dataset.py", line 391, in load_reconstruction with io.open_rt(self._reconstruction_file(filename)) as fin: File "/home/objloc/OBJLOC/OpenSfM/opensfm/io.py", line 546, in open_rt return io.open(path, 'r', encoding='utf-8') FileNotFoundError: [Errno 2] No such file or directory: 'data/0389_big/undistorted/reconstruction.json'

Is there any suggestions to improve it? Thank you very much!

mlopezantequera commented 4 years ago

Can you share a few of your images? perhaps then it's easier to understand what is going on

On Fri, Apr 24, 2020 at 11:53 AM Juuustin notifications@github.com wrote:

INFO: 0 partial reconstructions in total. Seems like the reconstruction step didn't predict any result. Not sure if it helps, but you could try to use more frames with higher fps (e.g. 50 frames and 2.5 fps) and set matching_order_neighbors: 7 and feature_min_frames: 7000 in data/0389_small/config.yaml.

Hi, thank you for your advice, and didn't downsample the frame this time, that is 30 fps and 87 frames in total, also I tried the parameters advised in config.yaml, and this is the output:

2020-04-24 11:20:36,055 DEBUG: Matching frame0953510210.jpg and frame0953510077.jpg. Matcher: FLANN (symmetric) T-desc: 0.842 T-robust: 0.010 T-total: 0.852 Matches: 5399 Robust: 5394 Success: True 2020-04-24 11:20:36,055 DEBUG: Image frame0953510210.jpg matches: 1 out of 1 2020-04-24 11:20:36,283 DEBUG: Image frame0953490275.jpg matches: 0 out of 0 2020-04-24 11:20:36,308 DEBUG: Image frame0953500176.jpg matches: 0 out of 0 2020-04-24 11:20:36,335 DEBUG: Image frame0953510077.jpg matches: 0 out of 0 2020-04-24 11:20:36,351 DEBUG: Image frame0953490475.jpg matches: 0 out of 0 2020-04-24 11:20:36,367 DEBUG: Image frame0953510511.jpg matches: 0 out of 0 2020-04-24 11:20:36,377 DEBUG: Image frame0953520044.jpg matches: 0 out of 0 2020-04-24 11:20:36,485 DEBUG: Matching frame0953510844.jpg and frame0953510711.jpg. Matcher: FLANN (symmetric) T-desc: 0.696 T-robust: 0.008 T-total: 0.704 Matches: 6018 Robust: 6016 Success: True 2020-04-24 11:20:36,485 DEBUG: Image frame0953510844.jpg matches: 1 out of 1 2020-04-24 11:20:36,569 DEBUG: Image frame0953490876.jpg matches: 0 out of 0 2020-04-24 11:20:36,571 INFO: Matched 338 pairs for 87 ref_images (perspective-perspective: 338) in 62.810014562215656 seconds (0.18582844794672754 seconds/pair). 2020-04-24 11:21:04,903 INFO: reading features 2020-04-24 11:21:05,866 DEBUG: Merging features onto tracks 2020-04-24 11:21:15,646 DEBUG: Good tracks: 62450 2020-04-24 11:21:42,115 INFO: Starting incremental reconstruction 2020-04-24 11:22:17,876 INFO: 0 partial reconstructions in total. Traceback (most recent call last): File "/home/objloc/OBJLOC/OpenSfM/bin/opensfm", line 34, in command.run(args) File "/home/objloc/OBJLOC/OpenSfM/opensfm/commands/compute_depthmaps.py", line 33, in run reconstructions = udata.load_undistorted_reconstruction() File "/home/objloc/OBJLOC/OpenSfM/opensfm/dataset.py", line 771, in load_undistorted_reconstruction filename=os.path.join(self.subfolder, 'reconstruction.json')) File "/home/objloc/OBJLOC/OpenSfM/opensfm/dataset.py", line 391, in load_reconstruction with io.open_rt(self._reconstruction_file(filename)) as fin: File "/home/objloc/OBJLOC/OpenSfM/opensfm/io.py", line 546, in open_rt return io.open(path, 'r', encoding='utf-8') FileNotFoundError: [Errno 2] No such file or directory: 'data/0389_big/undistorted/reconstruction.json'

Is there any suggestions to improve it? Thank you very much!

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/mapillary/OpenSfM/issues/587#issuecomment-618917014, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAH4OZ2PC7VPG7JJNRRXLOTROFOP5ANCNFSM4MNIYFUQ .

Juuustin commented 4 years ago

Can you share a few of your images? perhaps then it's easier to understand what is going on … On Fri, Apr 24, 2020 at 11:53 AM Juuustin @.**> wrote: INFO: 0 partial reconstructions in total. Seems like the reconstruction step didn't predict any result. Not sure if it helps, but you could try to use more frames with higher fps (e.g. 50 frames and 2.5 fps) and set matching_order_neighbors: 7 and feature_min_frames: 7000 in data/0389_small/config.yaml*. Hi, thank you for your advice, and didn't downsample the frame this time, that is 30 fps and 87 frames in total, also I tried the parameters advised in config.yaml, and this is the output: 2020-04-24 11:20:36,055 DEBUG: Matching frame0953510210.jpg and frame0953510077.jpg. Matcher: FLANN (symmetric) T-desc: 0.842 T-robust: 0.010 T-total: 0.852 Matches: 5399 Robust: 5394 Success: True 2020-04-24 11:20:36,055 DEBUG: Image frame0953510210.jpg matches: 1 out of 1 2020-04-24 11:20:36,283 DEBUG: Image frame0953490275.jpg matches: 0 out of 0 2020-04-24 11:20:36,308 DEBUG: Image frame0953500176.jpg matches: 0 out of 0 2020-04-24 11:20:36,335 DEBUG: Image frame0953510077.jpg matches: 0 out of 0 2020-04-24 11:20:36,351 DEBUG: Image frame0953490475.jpg matches: 0 out of 0 2020-04-24 11:20:36,367 DEBUG: Image frame0953510511.jpg matches: 0 out of 0 2020-04-24 11:20:36,377 DEBUG: Image frame0953520044.jpg matches: 0 out of 0 2020-04-24 11:20:36,485 DEBUG: Matching frame0953510844.jpg and frame0953510711.jpg. Matcher: FLANN (symmetric) T-desc: 0.696 T-robust: 0.008 T-total: 0.704 Matches: 6018 Robust: 6016 Success: True 2020-04-24 11:20:36,485 DEBUG: Image frame0953510844.jpg matches: 1 out of 1 2020-04-24 11:20:36,569 DEBUG: Image frame0953490876.jpg matches: 0 out of 0 2020-04-24 11:20:36,571 INFO: Matched 338 pairs for 87 ref_images (perspective-perspective: 338) in 62.810014562215656 seconds (0.18582844794672754 seconds/pair). 2020-04-24 11:21:04,903 INFO: reading features 2020-04-24 11:21:05,866 DEBUG: Merging features onto tracks 2020-04-24 11:21:15,646 DEBUG: Good tracks: 62450 2020-04-24 11:21:42,115 INFO: Starting incremental reconstruction 2020-04-24 11:22:17,876 INFO: 0 partial reconstructions in total. Traceback (most recent call last): File "/home/objloc/OBJLOC/OpenSfM/bin/opensfm", line 34, in command.run(args) File "/home/objloc/OBJLOC/OpenSfM/opensfm/commands/compute_depthmaps.py", line 33, in run reconstructions = udata.load_undistorted_reconstruction() File "/home/objloc/OBJLOC/OpenSfM/opensfm/dataset.py", line 771, in load_undistorted_reconstruction filename=os.path.join(self.subfolder, 'reconstruction.json')) File "/home/objloc/OBJLOC/OpenSfM/opensfm/dataset.py", line 391, in load_reconstruction with io.open_rt(self._reconstruction_file(filename)) as fin: File "/home/objloc/OBJLOC/OpenSfM/opensfm/io.py", line 546, in open_rt return io.open(path, 'r', encoding='utf-8') FileNotFoundError: [Errno 2] No such file or directory: 'data/0389_big/undistorted/reconstruction.json' Is there any suggestions to improve it? Thank you very much! — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#587 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAH4OZ2PC7VPG7JJNRRXLOTROFOP5ANCNFSM4MNIYFUQ .

it is not allowed to upload drone images on the Internet, but I can send two examples by Email if I have your Email address.

mlopezantequera commented 4 years ago

@Juuustin share with: manuel [-at-] mapillary.com

Juuustin commented 4 years ago

@Juuustin share with: manuel [-at-] mapillary.com

Hi, an example was sent just now. I tried again by myself, and this time the interval between each frame is a bit longer, meaning that the camera moved more than before, luckily there is an output, but the result is also a little weird. output_opensfm All the cameras are almost upside down, hope this could help you understand it and provide some suggestions to improve it. Thank you very much!

YanNoun commented 3 years ago

hi @Juuustin ,

Do you know the focal length of the device that took the video ?

Yann

Juuustin commented 3 years ago

hi @Juuustin ,

Do you know the focal length of the device that took the video ?

Yann

Hi @YanNoun ,

The 35 mm Format Equivalent is 24 mm.

taKumi1216 commented 3 years ago

Hi there　I’ｍ Japanese　college　student I'm having a similar problem right now. Here is the command in error

username: asphyxia

Traceback (most recent call last): File "/home/asphyxia/OpenSfM/bin/opensfm_main.py", line 26, in commands.opensfm_commands, create_default_dataset_context, dataset_choices=["opensfm"] File "/home/asphyxia/OpenSfM/opensfm/commands/command_runner.py", line 37, in command_runner command.run(data, args) File "/home/asphyxia/OpenSfM/opensfm/commands/command.py", line 12, in run self.run_impl(data, args) File "/home/asphyxia/OpenSfM/opensfm/commands/compute_depthmaps.py", line 11, in run_impl compute_depthmaps.run_dataset(dataset, args.subfolder, args.interactive) File "/home/asphyxia/OpenSfM/opensfm/actions/compute_depthmaps.py", line 20, in run_dataset reconstructions = udataset.load_undistorted_reconstruction() File "/home/asphyxia/OpenSfM/opensfm/dataset.py", line 1274, in load_undistorted_reconstruction with self.io_handler.open_rt(filename) as fin: File "/home/asphyxia/OpenSfM/opensfm/io.py", line 1314, in open_rt return cls.open(path, "r", encoding="utf-8") File "/home/asphyxia/OpenSfM/opensfm/io.py", line 1306, in open return open(*args, **kwargs) FileNotFoundError: [Errno 2] No such file or directory: 'data/doll/undistorted/reconstruction.json'

I think the problem is that the undistorted file is not created. What can I do to fix these problems? The pictures I used were taken with an iphone12 pro I am also using OpenSfM on ubuntu18.04 with wsl2.