huggingface / alignment-handbook

Robust recipes to align language models with human and AI preferences
https://huggingface.co/HuggingFaceH4
Apache License 2.0
4.28k stars 367 forks source link

Add warmup to config #71

Closed Randl closed 6 months ago

Randl commented 7 months ago

Somehow https://github.com/huggingface/alignment-handbook/pull/31 didn't add it in the end