search

OpenLLMAI / OpenRLHF

An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & Mixtral)
https://openrlhf.readthedocs.io/
Apache License 2.0
1.71k stars 160 forks source link

Does this codebase consider using "torch.compile"? #309

Closed eyuansu62 closed 1 month ago

hijkzzz commented 1 month ago

See https://github.com/microsoft/DeepSpeed/issues/5009

eyuansu62 commented 1 month ago

Thanks