search

Computer-Vision-in-the-Wild / DataDownload

MIT License
24 stars 4 forks source link

Question on experiment settings #3

Closed vincentlux closed 2 years ago

vincentlux commented 2 years ago

Hi, thanks a lot for organizing this benchmark dataset! Can you help clarify two details of the OD benchmark?

  1. For the eval scores reported in the ELEVATER paper, what is the evaluation metric? is it mAP or mAP@50?
  2. For the eval scores reported in the ELEVATER paper, are these scores from the test set or the validation set? Does this line indicate that the number is from the validation set?

Thanks a lot for your help!

haotian-liu commented 2 years ago

Closed as duplicate of #2