please add Word Movers Distance with ELMo Embeddings

Maluuba / nlg-eval

Evaluation code for various unsupervised automated metrics for Natural Language Generation.

http://arxiv.org/abs/1706.09799

Other

1.32k stars 220 forks source link

please add Word Movers Distance with ELMo Embeddings #52

Open bionicles opened 5 years ago

bionicles commented 5 years ago

It would be nice to add this metric because Word Movers Distance uses information geometry and ELMo uses contextual embeddings. I'm not familiar with all of your metrics so please correct me if there is an existing metric similar to this

tilmanbeck commented 4 years ago

There is an existing github implementation for sth similar: https://github.com/anonymous1001/Eval-Service