how to evaluate the output

freesunshine0316 / MPQG

Code corresponding to our paper "Leveraging Context Information for Natural Question Generation"

47 stars 10 forks source link

how to evaluate the output #12

Open SideOfTheRoad opened 4 years ago

SideOfTheRoad commented 4 years ago

I have decoded and get the test.sota.tok file, how can i get the evaluation of it?

freesunshine0316 commented 4 years ago

Hi,

We use the multi-bleu.perl file, which takes your generation outputs and another file containing all references. You may refer to this script and modify the path of the multi-bleu.perl script.