search

RUCAIBox / LLMSurvey

The official GitHub page for the survey paper "A Survey of Large Language Models".
https://arxiv.org/abs/2303.18223
10.13k stars 798 forks source link

Data error in KM scaling law #79

Open LJHzju opened 7 months ago

LJHzju commented 7 months ago

Regarding the KM scaling law in Chapter 2.1 of your paper, the model size range should be 768\~1.5B, not 7.68B\~1.5B, according to Figure 1(c) in the original OpenAI paper.

hyp1231 commented 7 months ago

Thank you for pointing out this bug! We will correct it in the next version of our paper.