Have you tested ELMo on Chinese?

allenai / bilm-tf

Tensorflow implementation of contextualized word representations from bi-directional language models

Apache License 2.0

1.62k stars 452 forks source link

Closed shuizhonghaitong closed 5 years ago

shuizhonghaitong commented 5 years ago

If you have conducted experiments on Chinese, how is the test perplexity?

matt-peters commented 5 years ago

I haven't run a Chinese only model, although others have. Potentially relevant citations:

Polyglot Contextual Representations Improve Crosslingual Transfer https://arxiv.org/pdf/1902.09697.pdf
Pretrained ELMo for Many Languages: https://github.com/HIT-SCIR/ELMoForManyLangs