openai / finetune-transformer-lm

Code and model for the paper "Improving Language Understanding by Generative Pre-Training"
https://s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf
MIT License
2.15k stars 503 forks source link

great dataset #46

Open amirakazadeh opened 5 years ago

amirakazadeh commented 5 years ago

hi

can anybody help me please? how can i upload a huge amount of data for LM (for example about 2 G) ??

tnx