[Finetune] Integrate DPO trainer for CPU and Gaudi - Githubissues

intel / llm-on-ray

Pretrain, finetune and serve LLMs on Intel platforms with Ray

Apache License 2.0

103 stars 30 forks source link

[Finetune] Integrate DPO trainer for CPU and Gaudi #238

Open minmingzhu opened 5 months ago