search

facebookresearch / MLQA

New dataset
Other
298 stars 24 forks source link

Model's predicted answers as a json dict #5

Closed shamitb closed 4 years ago

shamitb commented 4 years ago

How to generate the model's predicted answers as a json dict? Or is there a sample file that I can download from somewhere, what format etc is also not very clear...

patrick-s-h-lewis commented 4 years ago

Hi Shamit,

The evaluation script works like SQuAD v1, you provide a file of predicted answers as a json dictionary. The keys should be the question ID, the values should be a string which is the answer you want to predict.

Patrick

patrick-s-h-lewis commented 4 years ago

closing due to lack of activity