Update NGC and vllm version.

OpenLLMAI / OpenRLHF

An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & Mixtral)

https://openrlhf.readthedocs.io/

Apache License 2.0

1.72k stars 160 forks source link

Update NGC and vllm version. #282

Closed THINK2TRY closed 2 months ago

THINK2TRY commented 2 months ago

Thanks for the wonderful project! Does OpenRLHF support the use of the latest version of vllm and newer NGC (like 24.02), as vllm now is updated to v0.4.1 currently? Or what should I do to adapt OpenRLHF to them ?

hijkzzz commented 2 months ago

still work in progress The ray-related codes of VLLM v0.4.1 has changed a lot, which should take some time If you are interested, you can try to adapt it, just modify the vllm engine related code

hijkzzz commented 2 months ago

Just try https://github.com/OpenLLMAI/OpenRLHF/pull/283