salesforce / CodeGen

CodeGen is a family of open-source model for program synthesis. Trained on TPU-v4. Competitive with OpenAI Codex.
Apache License 2.0
4.94k stars 381 forks source link

What is the hardware requirement for fine tuning codegen 2B and higher models? #67

Open Kushalamummigatti opened 1 year ago

Kushalamummigatti commented 1 year ago

I have tried to finetune 2B on 40GB GPU which i faced memory out of error. Any suggestion to finetune 2B and above models?