search

lvapeab / nmt-keras

Neural Machine Translation with Keras
http://nmt-keras.readthedocs.io
MIT License
533 stars 130 forks source link

ELMo word embeddings #53

Open JohannesTK opened 6 years ago

JohannesTK commented 6 years ago

Have you thought of adding ELMo word embeddings to the selection? It outperforms both GloVe and Word2Vec embeddings.

Link to ELMo: https://github.com/allenai/allennlp/blob/master/tutorials/how_to/elmo.md

Implementation with Keras: https://towardsdatascience.com/elmo-embeddings-in-keras-with-tensorflow-hub-7eb6f0145440

lvapeab commented 6 years ago

Hi, never thought about it. It would be good to add it. I'll try to do it as I get some time. Thank you for the recommendation.

P.S. Feel free to implement it and open a PR with it ;)