How to finetune or lora on custom dataset

huggingface / alignment-handbook

Robust recipes to align language models with human and AI preferences

https://huggingface.co/HuggingFaceH4

Apache License 2.0

4.45k stars 385 forks source link

Open universewill opened 10 months ago

universewill commented 10 months ago

How to finetune or lora on custom dataset

lewtun commented 10 months ago

Hi @universewill we've now released the code and added some instructions for training on your own datasets here: https://github.com/huggingface/alignment-handbook/tree/main/scripts#fine-tuning-on-your-datasets

Let me know if you hit any issues!