search

epic-kitchens / epic-kitchens-55-annotations

🍴 Annotations for the EPIC KITCHENS-55 Dataset.
https://epic-kitchens.github.io/2020
Other
149 stars 26 forks source link

How can I get the test accuracy of action recognition benchmark? #27

Open Hou9612 opened 2 years ago

Hou9612 commented 2 years ago

Thanks for this wonderful work! I can't find the ground truth file of test dataset in this repository and the competition EPIC-KITCHENS-55 Action Recognition has ended, so how can I get the test accuracy of action recognition benchmark? I want to get the test accuracy of my model both on epic-kitchens-55 and epic-kitchens-100 datasets.

dimadamen commented 2 years ago

You can evaluate on the test sets through submitting to the leaderboards. The leaderboard fr EPIC-KITCHENS-55 Action Recognition is available here: https://competitions.codalab.org/competitions/20115

AntonyPapadakis commented 2 years ago

Hello there! Thank you for creating and maintaining a great project! In my case I am working with a subset ,i.e., some of the kitchens, of the epic-kitchens-55 dataset. I think I need ground truth test action labels, since I am not using the entire dataset to perform my experiments. Basically, I want to calculate accuracy on certain kitchens and not the whole dataset, so I guess the leaderboard option will not do. How can I get the the test accuracy in my case using a subset of the published test data ?