Full description can be found here: https://discuss.huggingface.co/t/pretrain-gpt-neo-for-open-source-github-copilot-model/7678?u=ncoop57
3.29k
stars
220
forks
source link
Try gradient accumulation for finetuning 1.3b for APPS #54
Open
mrinal18 opened 3 years ago