search

openai / finetune-transformer-lm

Code and model for the paper "Improving Language Understanding by Generative Pre-Training"
https://s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf
MIT License
2.15k stars 503 forks source link

what does the variable n_ctx mean ? #47

Open lshowway opened 5 years ago

lshowway commented 5 years ago

what does the variable n_ctx mean ? could you explain why it is computed like that ? n_ctx = min(max(max(len(x[:max_len]) for x in X) for X in [trX, vaX]) + 3, args.n_ctx)