openpsi-project / ReaLHF

Super-Efficient RLHF Training of LLMs with Parameter Reallocation
Apache License 2.0
114 stars 4 forks source link

[BUGFIX] Fix dockerfile and some known bugs. #32

Closed garrett4wade closed 3 months ago

garrett4wade commented 3 months ago

Changes: