lvis-dataset / lvis-api

Python API for LVIS Dataset
http://lvisdataset.org
Other
405 stars 62 forks source link

AP inconsistency #8

Closed tztztztztz closed 4 years ago

tztztztztz commented 5 years ago

❓ Questions and Help

The results of eval.AI is inconsistent with results of lvis api. Do you use different evalution code on eval.AI?

rbgirshick commented 5 years ago

We're following up privately on email to get specific information. Will update here with our findings.

rbgirshick commented 5 years ago

Confirmed in the Google Group that the inconsistency was due to using code from before the bug fix in 73142a45d38f77da13426a952c9b12e2dc256484.