search

OpenMOSS / CoLLiE

Collaborative Training of Large Language Models in an Efficient Way
https://openlmlab-collie.readthedocs.io
Apache License 2.0
405 stars 58 forks source link

支持 RLHF #145

Open KYLN24 opened 8 months ago

KYLN24 commented 8 months ago

参考 trl 和 DeepSpeed Chat，希望 collie 支持 RLHF 三阶段的训练流程。