search

jayleicn / singularity

[ACL 2023] Official PyTorch code for Singularity model in "Revealing Single Frame Bias for Video-and-Language Learning"
https://arxiv.org/abs/2206.03428
MIT License
129 stars 13 forks source link

Zero-shot performance on SSv2 #8

Closed vateye closed 1 year ago

vateye commented 2 years ago

Hi, I am curious about the zero-shot performance of different model on SSv2. Did you have the zero-shot performance of singularity on SSv2 label and template? Thanks.

jayleicn commented 2 years ago

Hi @vateye, we don't have results on SSv2 zero-shot, but it should be easy to evaluate it yourself using our code, following the instructions here: https://github.com/jayleicn/singularity#evaluation.