search

junxnone / aiwiki

AI Wiki
https://junxnone.github.io/aiwiki
17 stars 2 forks source link

Hot LM #408

Open junxnone opened 1 year ago

junxnone commented 1 year ago

大模型

timeline
    title History of Huge Model
    OpenAI: 2018 GPT: 2019 GPT-2: 2020 GPT-3: 2021 Codex: 2022 InstructGPT ChatGPT: 2023 GPT-4
    Google: 2018.10 BERT: 2019 XLNet T5: 2020.01 Meena : 2021  Switch Transformer mT5 ByT5 GLaM: 2022 LaMDA ST-MoE PaLM UL2    
    Meta: 2019.07 RoBERTa : 2020.04 Blender : 2023 LLaMa
    Stability AI : 2022 Stable Diffusion : 2023 StableLM
    Nvidia: 2019.09 Megatron-LM/BERT : 2021 MT-NLG
    Microsoft: 2019.11 DialoGPT : 2020 T-NLG: 2021 MT-NLG
    DeepMind: 2018 BigGAN-deep : 2021 Gopher AlphaFold 2 : 2022 Flamingo AlphaCode Chinchilla Gato

Reference