Adds fine-tuning notebooks

CodedotAl / gpt-code-clippy

Full description can be found here: https://discuss.huggingface.co/t/pretrain-gpt-neo-for-open-source-github-copilot-model/7678?u=ncoop57

Apache License 2.0

3.3k stars 224 forks source link

Closed arampacha closed 3 years ago

arampacha commented 3 years ago

Notes:

flax-gpt-neo-clm-v2.ipynb includes logging and profiling with tensorboard
added text_column_name argument to a script and updated bash scripts accordingly