VIS4ROB-lab / ccm_slam

CCM-SLAM: Robust and Efficient Centralized Collaborative Monocular SLAM for Robotic Teams
538 stars 107 forks source link

problem about experiment #39

Closed flyover-26 closed 2 years ago

flyover-26 commented 2 years ago

hi! I test ccm-slam in realworld,and I found a problem. When I move camera to a new scene,I found sometime it can not extracting feature points.I will track lost if I continue to move camera. Is this related to nFeatures in configure.yaml?or other reasons? thank you for your help! half-2 (ps:in the left side of picture,it can extract feature points,because it's the scene it has experienced.I move camera from left to right)

patriksc commented 2 years ago

Those are not the extracted features, but the ones that have a 3D point associated. Most likely, the front-end could not insert a new KF yet, and use it to triangulate new 3D points on the right side of the scene. I think you mentioned you are using a Xavier NX - maybe the CPU computation power is not sufficient, which can result in degraded performance with effects like this. Another reason could be too swift motion. Try moving slower, and to increase the distance between camera and scene if possible, this might help.

flyover-26 commented 2 years ago

thank you so much for your help! I successfully let map merged happened with two agents.But when I continue to run the system,I got a warning like !!! WARN !!! Replace:663 id mismatch MP 24895 --- optimize Ess grapgh --- Launch GBA thread LoopFinder: Wait for GBA to finish -> Starting Global Bundle Adjustment --> Optimizing Map 1 -- Contains Agents 0;1; ----> Loop KF: 154|0 ----- Add KFs ----- Add MPs And it is obvious that there is something wrong with map like trajectory distortion. Is this related to mismatch?(I change nFeatures in configure.yaml to 1500)or other reasons? I appreciate your help!

patriksc commented 2 years ago

A single mismatched landmark should not have a discernible impact of the estimate. A trajectory distortion could be caused by a wrong set of camera parameters. Particularly, if you observe a large plane perpendicular to the camera viewing direction, and the 3D points on this plane appear bent, this is a clear indicator of wrong camera parameters (e.g. the ground plain for a downward looking camera, but as well a large wall in a hand-held setup).

patriksc commented 2 years ago

Problem seems resolved - closing the issue.