search

allenai / unifiedqa

UnifiedQA: Crossing Format Boundaries With a Single QA System
https://arxiv.org/abs/2005.00700
Apache License 2.0
428 stars 43 forks source link

What are "flatten", "in_metadata" and "out_metadata" in dataloader? #35

Closed WindChimeRan closed 3 years ago

WindChimeRan commented 3 years ago

https://github.com/allenai/unifiedqa/blob/master/bart/data.py#L76

Hi I am trying to reuse the dataloader of unifiedqa, but I have no idea what are the metadata. Can anyone explain them?

Thanks!

danyaljj commented 3 years ago

Meta-data was sth that we used for evaluation; so for the most part, you don't need to worry about it.

If you'd like to run the model on your dataset or reproduce the number, I suggest you read the encoding described in the main readme.