CodedotAl / gpt-code-clippy

Full description can be found here: https://discuss.huggingface.co/t/pretrain-gpt-neo-for-open-source-github-copilot-model/7678?u=ncoop57
Apache License 2.0
3.29k stars 221 forks source link

Create gradient accumulation steps #29

Closed mrinal18 closed 3 years ago

mrinal18 commented 3 years ago

need to add few more things here. will update soon