A question about whether to try other data sets.

jayleicn / singularity

[ACL 2023] Official PyTorch code for Singularity model in "Revealing Single Frame Bias for Video-and-Language Learning"

https://arxiv.org/abs/2206.03428

MIT License

129 stars 13 forks source link

A question about whether to try other data sets. #3

Closed Decem-Y closed 2 years ago

Decem-Y commented 2 years ago

Have you tried to verify the effect of the model on SNLI-VE dataset?

jayleicn commented 2 years ago

Hi @Decem-Y, we don’t have plans for it, esp because we focus on video-text tasks.

Decem-Y commented 2 years ago

Hi @Decem-Y, we don’t have plans for it, esp because we focus on video-text tasks.

OK, thanks for your reply, but SNLI-VE is a fine-grained visual reasoning task to predict whether the relationship between an image and a text is entailment, neutral, or contradictory. Maybe its test data has been reported to be noisy.