Cherry pick `docs: Add sidebar headings for RPO/IPO/DPO with LoRA (319)` into `r0.5.0`

NVIDIA / NeMo-Aligner

Scalable toolkit for efficient model alignment

Apache License 2.0

620 stars 78 forks source link

Closed ko3n1g closed 1 month ago

ko3n1g commented 1 month ago

[🤖]: Hi @terrykong 👋,

we've cherry picked #319 into r0.5.0 for you! 🚀

Please review and approve this cherry pick by your convenience!