Lightning-AI / litgpt

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
https://lightning.ai
Apache License 2.0
9.79k stars 980 forks source link

Can I use Wizardcoder to finetune? #555

Open hello-eternity opened 1 year ago

hello-eternity commented 1 year ago

Wizardcoder is the best open source code LLM recently. It seems base on Starcoder. How can I finetune this model?

carmocca commented 1 year ago

Unfortunately, this repo doesn't support those checkpoints at the moment