启用PPO Ray后无响应

OpenLLMAI / OpenRLHF

An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & Mixtral)

https://openrlhf.readthedocs.io/

Apache License 2.0

1.71k stars 160 forks source link

Closed victorShawFan closed 1 month ago

victorShawFan commented 1 month ago

使用ray start命令的反应：

运行train_ppo_llama.sh后的反应

victorShawFan commented 1 month ago

脚本修改情况

hijkzzz commented 1 month ago

可能是脚本目录下文件太多 ray 一直在打包上传文件如果有大文件建议移出 openrlhf 目录

victorShawFan commented 1 month ago

是这个问题，已解决 thanks