search

binmakeswell / ColossalChat

ColossalChat is the project to implement LLM with RLHF, powered by the Colossal-AI project.
https://github.com/hpcaitech/ColossalAI/tree/main/applications/Chat
Apache License 2.0
61 stars 17 forks source link

Training data example #2

Closed tonylin52 closed 1 year ago

tonylin52 commented 1 year ago

Hi,

This project is awosome! Could you please release some pretrain_dataset examples? So I could train in the PPO training phase. Thanks a lot!

tonylin52 commented 1 year ago

Oh I found it!