how could i train the language with chinese

openai / finetune-transformer-lm

Code and model for the paper "Improving Language Understanding by Generative Pre-Training"

MIT License

2.14k stars 499 forks source link

Open wykdg opened 6 years ago

wykdg commented 6 years ago

how could i train the language with chinese ，but the code only shows how to finetune the model. thanks

youngkyung commented 6 years ago

Me too. I need the way how to finetune the model with the other language. Can you share how to pretrain the model? Thank you in advance.

xuy2 commented 6 years ago

use the lm_loss as the optimization target.

tomeasure commented 5 years ago

how could i train the language with chinese ，but the code only shows how to finetune the model. thanks

same question.