laxnpander / OpenREALM

OpenREALM is a pipeline for real-time aerial mapping utilizing visual SLAM and 3D reconstruction frameworks.
GNU Lesser General Public License v2.1
443 stars 114 forks source link

No tracking on my dataset #105

Closed lyy-1997 closed 2 months ago

lyy-1997 commented 4 months ago

Thanks a lot for your work. I have successfully run gnss,noreo and reco using both the provided test data set and my own (1014x760 resolution, 126m flight altitude). However, when I used a dataset with a resolution of 6144x4096 and a flight altitude of 171m, I was never able to complete 3D mapping.Even if the camera parameters are perfectly correct, there are still a few things that are strange. 1.No tracking has been displayed since the beginning. 2.Even though the image has obvious features, there are almost no feature points in rviz. Since I have previously successfully run the data set of 1014x760 resolution (the resolution is similar to the test data set provided), I am guessing that the resolution of 6144x4096 May be causing the problem? Or was it flight altitude?If so, how should I configure it correctly?THANKS! By the way, I only changed the camera parameter configuration in profile/*/camera/calib.yaml, and the resolution Settings were consistent with the image size.

Here is the output file. output.txt

noFeaturePoints output

laxnpander commented 3 months ago

@lyy-1997 Hey, welcome to the dark arts of tuning OpenREALM. I am pretty sure your image resolution is way too high.I'd start with significantly smaller images. You can resize them automatically using the configs in the respective profile, e.g.

https://github.com/laxnpander/OpenREALM_ROS1_Bridge/blob/65a86d465b5ba0b5256f5c8f1bb8090ec3a027f8/realm_ros/profiles/alexa_reco/pose_estimation/method/orb_slam3_settings.yaml#L6

So set resizing to 0.2 and see if the results improve. You can also increase nrof features if you have the processing power to back it up.

lyy-1997 commented 3 months ago

Thanks for your reply. I've switched to a lower resolution dataset and got the desired results. So I think it's the resolution of the dataset. When I set resizing to 0.2, do I need to adjust the camera parameters in calib.yam for the dataset with a high resolution? If so, how should I set the camera parameters?I guese, keep other parameters unchanged, only adjust the width and height of the camera parameters to 0.2 times the original? By the way, does the current version successfully support ORBSLAM3, because I saw that you mentioned ORBSLAM3 in your reply?

laxnpander commented 3 months ago

@lyy-1997 Ah jeah, ORBSLAM3 was tested by me, but it is not the default in the repo atm. OpenVSLAM was performing better in most cases. The camera parameters are scaled automatically according to the resize value you set. So you don't have to edit them manually.

laxnpander commented 2 months ago

Reopen if issues persists.