search

X-lab2017 / open-research

📚 用开源的方法来研究开源的现象。（open source methodology for open source phenomena）
51 stars 18 forks source link

[Presentation] Improving Language Understandingby Generative Pre-Training（GPT1.0） #215

Open PureNatural opened 1 year ago

PureNatural commented 1 year ago

Title

Improving Language Understanding by Generative Pre-Training（GPT1.0）

Link

https://s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf

Year

2018

Author and affiliation

Alec Radford OpenAI Karthik Narasimhan OpenAI Tim Salimans OpenAI Ilya Sutskever OpenAI

Conference or Journal

-

Rank

No response

Keywords

-

Selecting Reason

学习GPT模型的构建方法以及后续如何针对特定的任务展开微调

Supplementary

GPT2.0 https://cdn.openai.com/better-language-models/language_models_are_unsupervised_multitask_learners.pdf GPT3.0 https://papers.nips.cc/paper/2020/file/1457c0d6bfcb4967418bfb8ac142f64a-Paper.pdf GPT4.0 https://openai.com/research/gpt-4