Cysu / open-reid

Open source person re-identification library in python
https://cysu.github.io/open-reid/
MIT License
1.33k stars 349 forks source link

About Evaluation #58

Open wang5566 opened 6 years ago

wang5566 commented 6 years ago

I find there are three benchmarks including 'cmc all shots', 'cmc cuhk03', 'cmc market1501'. I want to know what meaning do they represent seperately ? Does cmc cuhk03 mean single-shot and cmc market1501 mean multi-shot? Lastly, I know the new split method for cuhk03 training set in https://github.com/zhunzhong07/person-re-ranking#the-new-trainingtesting-protocol-for-cuhk03 and your open-reid does not use it. And the performance seems quite different in baseline method? Any reply will be appreciated. Thank you.

Cysu commented 6 years ago

Does this section on our website help?

wang5566 commented 6 years ago

Yes, but what is "all shot "meaning?

ercanburak commented 6 years ago

Hi @Cysu and @wang5566,

I also have the same question: what exactly is the meaning of "allshots"?

I checked the documentation website but could not find an explanation. I also looked a bit into the code without going deeper, but still I have no answer. Any answer will be appreciated, and also thanks for the repo.

RaviShivam commented 4 years ago

Hi @ercanburak @wang5566 Did you ever get this question answered?