search

openai / weak-to-strong

MIT License
2.48k stars 300 forks source link

How to use GPT-4 as strong model #35

Open sr5434 opened 6 months ago

sr5434 commented 6 months ago

Hi! How would I go about using GPT-4 as a strong model to finetune GPT-2? Also, how expensive would it be(in terms of OpenAI API costs)?

notlober commented 3 months ago

it is weak to strong generalization, which you use gpt2 labels to train larger model eg. gpt4. not other way.