search

SysCV / sam-pt

SAM-PT: Extending SAM to zero-shot video segmentation with point-based tracking.
https://arxiv.org/abs/2307.01197
Apache License 2.0
950 stars 60 forks source link

How to get evaluation results for DAVIS2016, YouTube2018 and MOSE? #26

Closed jameslahm closed 8 months ago

jameslahm commented 9 months ago

Thank you for your great work! Would you mind sharing the code to get the evaluation results for DAVIS2016, YouTube2018 and MOSE? Thanks a lot!

m43 commented 9 months ago

Hi! Thanks for your interest. You can download those datasets as described here. Then, you can run the VOS experiments as described here. To finally get the evaluation results/scores on the datasets you mentioned, upload the zipped results from the output folder (e.g., the eval_D17_val.zip) to the relevant evaluation server. At the time of writing this, the evaluation servers can be accessed at: YouTube-VOS 2018, MOSE 2023.

For DAVIS 2016, there is no online evaluation server, but I have now added support within this codebase. Please refer to the evaluator script here as well as the snippet here. Note that the requirements.txt have been updated as well, so you might want to run pip install -r requirements.txt for the DAVIS 2016 evaluator to work.

jameslahm commented 8 months ago

Thank you!