openai / finetune-transformer-lm

Code and model for the paper "Improving Language Understanding by Generative Pre-Training"
https://s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf
MIT License
2.14k stars 499 forks source link

How to pretrain the model? #27

Open ShuGao0810 opened 5 years ago

ShuGao0810 commented 5 years ago

could u share the pretrain code?

guotong1988 commented 5 years ago

same question