mbrossar / denoise-imu-gyro

Convolutional Neural Networks for Denoising Gyroscopes of Low-Cost IMUs
MIT License
316 stars 66 forks source link

Different test results on TUM-VI datasets #6

Open Dynamite321 opened 3 years ago

Dynamite321 commented 3 years ago

Hi,

I downloaded your pre-trained model on TUM-VI and evaluated it by the toolbox provided by https://github.com/uzh-rpg/rpg_trajectory_evaluation, which is also recommended by open-vins (https://docs.openvins.com/namespaceov__eval.html). The AOE results for rooms 2, 4, and 6 are 1.87, 1.44, and 1.93, respectively. However, the results provided by your paper are 1.31, 1.48, and 1.04. I wonder whether this is because of the existence of outliers in TUM-VI datasets and I need to remove them before I run the evaluation. Could you please give me any clue?

P.S. The evaluation results of EuRoC datasets with the toolbox provided by https://github.com/uzh-rpg/rpg_trajectory_evaluation are exactly the same as your paper.

Thanks!

RXvo commented 2 years ago

Hi,

I downloaded your pre-trained model on TUM-VI and evaluated it by the toolbox provided by https://github.com/uzh-rpg/rpg_trajectory_evaluation, which is also recommended by open-vins (https://docs.openvins.com/namespaceov__eval.html). The AOE results for rooms 2, 4, and 6 are 1.87, 1.44, and 1.93, respectively. However, the results provided by your paper are 1.31, 1.48, and 1.04. I wonder whether this is because of the existence of outliers in TUM-VI datasets and I need to remove them before I run the evaluation. Could you please give me any clue?

P.S. The evaluation results of EuRoC datasets with the toolbox provided by https://github.com/uzh-rpg/rpg_trajectory_evaluation are exactly the same as your paper.

Thanks!

你好 请问你还有这个程序的优化参数和对应的数据集吗 感谢

successkaisadadi commented 2 years ago

Hi,

I downloaded your pre-trained model on TUM-VI and evaluated it by the toolbox provided by https://github.com/uzh-rpg/rpg_trajectory_evaluation, which is also recommended by open-vins (https://docs.openvins.com/namespaceov__eval.html). The AOE results for rooms 2, 4, and 6 are 1.87, 1.44, and 1.93, respectively. However, the results provided by your paper are 1.31, 1.48, and 1.04. I wonder whether this is because of the existence of outliers in TUM-VI datasets and I need to remove them before I run the evaluation. Could you please give me any clue?

P.S. The evaluation results of EuRoC datasets with the toolbox provided by https://github.com/uzh-rpg/rpg_trajectory_evaluation are exactly the same as your paper.

Thanks! Hello, has your problem been solved? You can try using the evaluation tool provided by openvins!

huazai665 commented 2 years ago

image

This is my results according to openVins, but I don't find AOE in result, and the result is not same as the AOE in paper. I also test it in https://github.com/uzh-rpg/rpg_trajectory_evaluation

scarLiu commented 1 year ago

image

This is my results according to openVins, but I don't find AOE in result, and the result is not same as the AOE in paper. I also test it in https://github.com/uzh-rpg/rpg_trajectory_evaluation

你好!你的数据集和优化参数现在还在嘛,可否给我发一份?17301160@bjtu.edu.cn

dreamer1031 commented 1 year ago

image This is my results according to openVins, but I don't find AOE in result, and the result is not same as the AOE in paper. I also test it in https://github.com/uzh-rpg/rpg_trajectory_evaluation

你好!你的数据集和优化参数现在还在嘛,可否给我发一份?17301160@bjtu.edu.cn

do you get the dataset and parameters now? if you do , can you send one to me ? my email address is yanfshen@163.com! thank you !

alun9258 commented 5 months ago

Hi, I downloaded your pre-trained model on TUM-VI and evaluated it by the toolbox provided by https://github.com/uzh-rpg/rpg_trajectory_evaluation, which is also recommended by open-vins (https://docs.openvins.com/namespaceov__eval.html). The AOE results for rooms 2, 4, and 6 are 1.87, 1.44, and 1.93, respectively. However, the results provided by your paper are 1.31, 1.48, and 1.04. I wonder whether this is because of the existence of outliers in TUM-VI datasets and I need to remove them before I run the evaluation. Could you please give me any clue? P.S. The evaluation results of EuRoC datasets with the toolbox provided by https://github.com/uzh-rpg/rpg_trajectory_evaluation are exactly the same as your paper. Thanks!

你好 请问你还有这个程序的优化参数和对应的数据集吗 感谢

Hello, do you still have the corresponding optimization parameters and data set of this code? The author's links have all failed. Thank you!

alun9258 commented 5 months ago

image This is my results according to openVins, but I don't find AOE in result, and the result is not same as the AOE in paper. I also test it in https://github.com/uzh-rpg/rpg_trajectory_evaluation

你好!你的数据集和优化参数现在还在嘛,可否给我发一份?17301160@bjtu.edu.cn

Hello, do you still have the corresponding optimization parameters and data set of this code? The author's links have all failed. Thank you!wyilun@pku.edu.cn

alun9258 commented 5 months ago

image This is my results according to openVins, but I don't find AOE in result, and the result is not same as the AOE in paper. I also test it in https://github.com/uzh-rpg/rpg_trajectory_evaluation

你好!你的数据集和优化参数现在还在嘛,可否给我发一份?17301160@bjtu.edu.cn

do you get the dataset and parameters now? if you do , can you send one to me ? my email address is yanfshen@163.com! thank you !

Hello, do you still have the corresponding optimization parameters and data set of this code? The author's links have all failed. Thank you!wyilun@pku.edu.cn