Wrong submission feedback for Question NLI

nyu-mll / GLUE-baselines

[DEPRECATED] Repo for exploring multi-task learning approaches to learning sentence representations

https://gluebenchmark.com

739 stars 164 forks source link

Wrong submission feedback for Question NLI #14

Closed player1321 closed 4 years ago

player1321 commented 5 years ago

It seems that you only updated the task data for Question NLI, but not the evaluation code. When I submitted the QNLI.tsv file, it shows "not all ids present in task Question NLI". Then I tried to submit the old version but only the number of ids was right, and there were something wrong with the evaluation result.

apsdehal commented 5 years ago

Hey, from where are you downloading the data for QNLI? Can you download it from website and try again.

We are having a lot of submissions everyday but no one is facing this issue. So, you might be downloading wrong version of QNLI.

player1321 commented 4 years ago

I downloaded the data from website. When I download it again it works. Thanks a lot for your reply.