openai / finetune-transformer-lm

Code and model for the paper "Improving Language Understanding by Generative Pre-Training"
https://s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf
MIT License
2.14k stars 499 forks source link

Supported languages #2

Open ErikTromp opened 6 years ago

ErikTromp commented 6 years ago

Probably running ahead of things, but the generic model(s) you plan to release are for English only I suppose?

I would really be interested in ones for more languages, kind of like fasttext has done.

Otherwise I'd have to resort to training them myself on my single GPU :(

Any plans for more languages?

FrankWork commented 6 years ago

I need to train Chinese language model. Here is a fork: https://github.com/IndicoDataSolutions/finetune