Training using a custom prompt format and custom dataset

huggingface / alignment-handbook

Robust recipes to align language models with human and AI preferences

https://huggingface.co/HuggingFaceH4

Apache License 2.0

4.55k stars 393 forks source link

Training using a custom prompt format and custom dataset #48

Closed BakingBrains closed 10 months ago

BakingBrains commented 10 months ago

Thank you for sharing the training code.

Can you please point the files or the places needs attention when following the same recipe for to train the model with different prompt template and custom dataset. (Not the chat)

Any suggestions here?

Regards