How to calculate the metrics used in this paper?

iamaaditya / neural-paraphrase-generation

Neural Paraphrase Generation

179 stars 57 forks source link

How to calculate the metrics used in this paper? #6

Closed egrcc closed 6 years ago

egrcc commented 6 years ago

Hi,

It seems that the metrics (BLEU, METEOR, TER) are not calculated in this code. How can I compare the results of this code with those in the paper? Could you please show me the way? Thanks.

iamaaditya commented 6 years ago

Original BLEU https://github.com/moses-smt/mosesdecoder/blob/master/scripts/generic/multi-bleu.perl Better implementation https://github.com/tensorflow/nmt/blob/master/nmt/utils/evaluation_utils.py Some more here https://github.com/lium-lst/nmtpy/tree/master/nmtpy/metrics