loubnabnl / santacoder-finetuning

Fine-tune SantaCoder for Code/Text Generation.
Apache License 2.0
179 stars 22 forks source link

Can I use it to fine tune bigcode/starcoderplus? #21

Closed tclxmeng-jia closed 11 months ago

tclxmeng-jia commented 11 months ago

refer the title or subject (in an online forum),What changes do I need to make?

loubnabnl commented 11 months ago

You might have trouble fitting starcoderplus in your GPU memory, you can check this repo: https://github.com/bigcode-project/starcoder for using PEFT or DeepSpeed