search

Maluuba / nlg-eval

Evaluation code for various unsupervised automated metrics for Natural Language Generation.
http://arxiv.org/abs/1706.09799
Other
1.35k stars 224 forks source link

meteor issue #120

Open 520jefferson opened 3 years ago

520jefferson commented 3 years ago

The meteor don't have the chinese word data, and the meteor mainpage don't have too. whether it's not proper to evaluate chinese nlg task using meteor ？

kracwarlock commented 3 years ago

Yes, Chinese doesn't seem to be supported by METEOR: https://www.cs.cmu.edu/~alavie/METEOR/README.html. Some of the other metrics would work but we don't provide tokenizers for Chinese. If you can handle that you should be able to make the other metrics work.