openai / finetune-transformer-lm

Code and model for the paper "Improving Language Understanding by Generative Pre-Training"
https://s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf
MIT License
2.14k stars 499 forks source link

Is it possible to edit the code based on this project to train from scratch? #42

Open guotong1988 opened 5 years ago

guotong1988 commented 5 years ago

Is it possible? To achieve maybe 90% of the experiment result in the paper. Thank you very much!