search

jayleicn / singularity

[ACL 2023] Official PyTorch code for Singularity model in "Revealing Single Frame Bias for Video-and-Language Learning"
https://arxiv.org/abs/2206.03428
MIT License
130 stars 14 forks source link

Results minival vs minival_emb #9

Closed avinashsai closed 2 years ago

avinashsai commented 2 years ago

Hi,

I was wondering which of the two values (minival & minival_emb) is reported in the paper.

Thank you.

jayleicn commented 2 years ago

Hi @avinashsai, we use minival. The metrics with suffix _emb is the intermediate retrieval results from the contrastive scores.