add perf and benchmark scripts

OpenLLMAI / OpenRLHF

An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & Mixtral)

https://openrlhf.readthedocs.io/

Apache License 2.0

1.72k stars 160 forks source link

Closed wuxibin89 closed 2 months ago

hijkzzz commented 3 months ago

We also need data from DSChat without Adam Offload

catqaq commented 3 months ago

Any chance to test the A100 40G? Of course, this is not a high priority at the moment.

wuxibin89 commented 3 months ago

Any chance to test the A100 40G? Of course, this is not a high priority at the moment.

I have no A100 40G for now :(