search

cheind / py-motmetrics

:bar_chart: Benchmark multiple object trackers (MOT) in Python
MIT License
1.36k stars 258 forks source link

Questions about values #185

Open hongin13 opened 7 months ago

hongin13 commented 7 months ago

I used py-motetrics because I wanted to get mota, motp for the custom dataset, and I got the results. Mota outputs a value around 0.8, while motp outputs a value around 0.1. The result of motp is so weird, is this a problem caused by incorrectly generating dataset?

cheind commented 7 months ago

Hey @hongin13, does this statement in Readme.md resolve your question?

Metric MOTP seems to be off. To convert compute (1 - MOTP) * 100. MOTChallenge benchmarks compute MOTP as percentage, while py-motmetrics sticks to the original definition of average distance over number of assigned objects [1].

hongin13 commented 7 months ago

Can this statement be interpreted as "(1 - motp) is the appropriate motp calculation result"?