Open MosaabMuhammed opened 2 months ago
In the "5. Preference Alignment" section, the link in "Fine-tune Mistral-7b with DPO" refers to a Huggingface article about how to fine-tune llama2 with RLHF NOT Mistral-7b, I guess the correct link would be --> https://mlabonne.github.io/blog/posts/Fine_tune_Mistral_7b_with_DPO.html
Thanks for noticing @MosaabMuhammed, just fixed it!
In the "5. Preference Alignment" section, the link in "Fine-tune Mistral-7b with DPO" refers to a Huggingface article about how to fine-tune llama2 with RLHF NOT Mistral-7b, I guess the correct link would be --> https://mlabonne.github.io/blog/posts/Fine_tune_Mistral_7b_with_DPO.html