CodeGen is a family of open-source model for program synthesis. Trained on TPU-v4. Competitive with OpenAI Codex.
4.94k
stars
381
forks
source link
What is the hardware requirement for fine tuning codegen 2B and higher models? #67
Open
Kushalamummigatti opened 1 year ago
I have tried to finetune 2B on 40GB GPU which i faced memory out of error. Any suggestion to finetune 2B and above models?