Closed luzai closed 6 years ago
Please see issue #16. The code in issue #16 follows the offical splitting. And the author has explained the reason .
Indeed, there is little difference between splitting by query person IDs and splitting by query images.
Meanwhile, I am sorry for my mistake, the mAP of original paper is 69.14
using triplet+batch hard mining, and 81.07
after rerank. Open-reid has reached excellent 67.9
!
The paper used ten crops for test-time augmentation while open-reid not. If applied test-time augmentation in open-reid, the results will be higher.
@zydou Thank you very much for the explanation!
@luzai Thank you for pointing out the issue. Will try my best to fix it.
Market 1501 evaluation protocol uses fixed 3368 high-quality images as query. It is because we can easily draw high quality bounding box for query pedestrian.
In this sense,
reis.datasets.market1501
did not follow the official evaluation protocol.This may explain why the demo code
python examples/triplet_loss.py -d market1501
only has 67.9 mAP much lower than soa. For an visual case,