search

openai / weak-to-strong

MIT License
2.5k stars 305 forks source link

what's the meaning of fraction of GPT4? #17

Closed ljch2018 closed 10 months ago

ljch2018 commented 10 months ago
image

I read the original paper, but met some problems about the graph.

  1. What's the meaning of fraction of GPT4 (X-axis) ?
  2. Is one line stand for a different student model?

Thank you very much.

zidong-onepiece1 commented 10 months ago

1.The fraction of GPT4 (X-axis) may represents the size of the student model, '1' represents GPT4, 10^-2 represents GPT4 parameters * 0.01 and so on.

  1. one line represents weak model conpute. The lighter the color, the greater the weak model conpute.
WuTheFWasThat commented 10 months ago

zidong is correct except that 10^(-2) doesn't necessarily mean parameters * 0.01, it means less parameters and trained for 0.01x the compute