Open minghanz opened 4 years ago
@minghanz In my origin code, savetrajectory_tum()
is used to save traj data.
Use evo_ape tum ...
for evaluation.
@RonaldSun However, as in said in https://github.com/MichaelGrupp/evo/wiki/Formats:
In euroc mode, evo's metrics require you to give the reference in the EuRoC format and the estimated trajectory in the TUM format.
which is the case here. The ground truth file of Euroc dataset is in csv format so that tum
mode cannot be used. So I think using euroc
mode is correct here. Am I missing anything?
@minghanz You can check https://github.com/RonaldSun/VI-Stereo-DSO/blob/master/src/FullSystem/FullSystem.cpp#L1206 I saved both dso and groundtruth trajs in tum format, so you can use the saved files in tum mode.
@RonaldSun I freshly cloned and built this repo again. Then I run the V1_01 sequence. I run the command evo_ape tum ~/Repos/VI-Stereo-DSO/data/nt_V1_01_easy_gt.txt ~/Repos/VI-Stereo-DSO/data/nt_V1_01_easy.txt --align
. or with -s
.
In monocular mode, the rmse is 0.18 with SE3 alignment, and 0.06 with Sim3 alignment. In stereo mode, the rmse is 0.052 with SE3 alignment, and 0.047 with Sim3 alignment.
Are these results roughly aligned with your experiments? I did not see you specifying the mode (mono or stereo) in reporting the quantitative result. I assume it is stereo.
My results are based on stereo mode. I haven't tested monocular results. Your results seem right.
Hi RonaldSun,
Thanks for the open source code. I can now successfully run your code on the Euroc data sequences. Then I evaluated the accuracy of the trajectories using the tool by https://github.com/MichaelGrupp/evo. I tried both SE3 alignment and Sim3 alignment, but the reported RMSE is not the same as listed in the readme. I ran several times, and the rmse of V1_01 sequence is about 0.2 in both monocular and stereo mode, while the value in readme is 0.0599. Do you have any idea what might be the reason?
The script I used to run the program in stereo mode is as below, if it's helps.
The script I used to run evaluation in SE3 alignment mode is:
Thanks for your help!