allenai / rainbow

Neural models of common sense. 🤖
Apache License 2.0
94 stars 6 forks source link

Remove ReCoRD from the common sense datasets #35

Closed nalourie-ai2 closed 4 years ago

nalourie-ai2 commented 4 years ago

Remove ReCoRD from the common sense datasets and the custom dataset preparation. Unlike the other common sense datasets, each instance from ReCoRD has multiple correct answers, this means that ReCoRD is evaluated differently and requires separate logic for things like early stopping and evaluation scripts. So, we're cutting it from the scope.