Try to test ELMO language model

localminimum / QANet

A Tensorflow implementation of QANet for machine reading comprehension

MIT License

983 stars 305 forks source link

Try to test ELMO language model #38

Open tuan3w opened 6 years ago

tuan3w commented 6 years ago

Hi all, As both results from Google Brain team and AllenNPL, using ELMO can give a big boost in result. I noticed that AllenNLP provides some pretrained model of ELMO. I would love to see some better results. Thanks. [1] QANet slide [2] ELMO page

ZhaoyueCheng commented 6 years ago

yeah, ELMO gives boost for the Bidaf model like 4 points

localminimum commented 6 years ago

Hi @tuan3w , implementing ELMo is definitely one of the priorities. I will work on it as soon as I have some time. Thanks