allenai / unifiedqa

UnifiedQA: Crossing Format Boundaries With a Single QA System
https://arxiv.org/abs/2005.00700
Apache License 2.0
428 stars 43 forks source link

Addition of new datasets #29

Closed yeganehkordi closed 2 years ago

danyaljj commented 2 years ago

Inside the meta corresponding to "onestopqa_advanced" data I see the following:

1   A
2   A
3   A
4   A
5   A
6   A
7   A
8   A
9   A
10  A
11  A
12  A
13  A
14  A
15  A
16  A
17  A
18  A
19  A
20  A
21  A

Is this correct? (all the answers are "A"?)

yeganehkordi commented 2 years ago

Is this correct? (all the answers are "A"?)

Yes, all the answers were "A" in the dataset. Should I shuffle the options?