EricLBuehler / candle-lora

Low rank adaptation (LoRA) for Candle.
MIT License
124 stars 10 forks source link

Could we have a written walkthrough of finetuning llama/mistral with this? #17

Open Tameflame opened 4 months ago

Tameflame commented 4 months ago

I'm really excited with finetuning LLMs on rust but I'm a complete beginner to machine learning so even though I've spent some time going through the repo it would be great if there was a plainwritten tutorial or step by step guide on finetuning some of the more popular models with this.

Thanks!

EricLBuehler commented 4 months ago

@Tameflame, yes, absolutely. I'll take a look at adding this very soon.

jamesfebin commented 6 days ago

Any update on this?