Any model trained for other languages?

zihangdai / xlnet

XLNet: Generalized Autoregressive Pretraining for Language Understanding

Apache License 2.0

6.18k stars 1.18k forks source link

Any model trained for other languages? #161

Open iuria21 opened 5 years ago

iuria21 commented 5 years ago

Is it any XLNet model trained in other languages? Thanks!

stefan-it commented 5 years ago

I'm currenly running experiments for Basque with different BPE sizes 😅

iuria21 commented 5 years ago

joke?

stefan-it commented 5 years ago

No, I'm working on a project (together with @anebz) on contextualized embeddings for Basque. I've trained ELMo and Flair Embeddings from scratch (will be released in a few days) and XLNet embeddings are currently training. Evaluation will be done on EIEC for NER and Universal Dependencies for PoS tagging.

iuria21 commented 5 years ago

wow, sorry! I didn't think someone in Munich would be working with Basque 😅 In any case, I'm working mainly in Spanish (despite my nickname), so I was asking for some model in Spanish... but nice to know about you!