search

LJacksonPan / RaTrack

[ICRA2024] RaTrack: Moving Object Detection and Tracking with 4D Radar Point Cloud
https://github.com/LJacksonPan/RaTrack
MIT License
94 stars 16 forks source link

About the method of evaluation #10

Closed altfrog closed 4 weeks ago

altfrog commented 1 month ago

First, it's a nice work! And I would like to know how to get the index such as "AMOTA" shown in paper, since when I ran "python main.py --config configs_eval.yaml" only got the result: {'acc': 0.665439362981125, 'miou': 0.3327195646320973, 'sen': 0.5} {'rne': 0.14621314785850364, '50-50 rne': nan, 'mov_rne': 0.0, 'stat_rne': nan, 'sas': 0.9976320735841153, 'ras': 0.9998527087334035, 'epe': 0.34478783385957384}. Is there any other evaluate scripts didn't uploaded? Thanks!

MrTooOldDriver commented 1 month ago

Hi. Thank you for your interest in our work. The metrics you saw are just debugging metrics for the scene flow and motion segmentation module. Regarding the evaluation script, we have stated it in the README Q&A:

Q: Regarding Our Modified AB3DMOT Evaluation Code A: Due to AB3DMOT's repository license, we are currently not able to distribute our modified version of the AB3DMOT evaluation. We are contacting AB3DMOT's authors to gain permission for distribution.

We are still working on gaining permission from them.