search

facebookresearch / MLQA

New dataset
Other
298 stars 24 forks source link

Scripts for Translate-Test #2

Closed adymaharana closed 5 years ago

adymaharana commented 5 years ago

Hi,

Thanks for the valuable dataset! It is so much easier to add a multilingual component to QA projects now. :) Will you also be releasing the scripts for different evaluation methodologies? I am interested in the Translate-Test method and I see that you have referenced this paper for it. Did you use their method of pretraining an NMT model too? Kindly let me know. Thanks!

patrick-s-h-lewis commented 5 years ago

Dear Adymaharana,

Thanks for your interest in the project :)

Will you also be releasing the scripts for different evaluation methodologies?

We hope to release as much of our implementations as possible.

Did you use their method of pretraining an NMT model too?

As mentioned in the paper, we use Facebook's Production Machine Translation system.

Patrick