search

openpsi-project / ReaLHF

Super-Efficient RLHF Training of LLMs with Parameter Reallocation
Apache License 2.0
82 stars 4 forks source link

Fix mixtral model conversion #52

Closed garrett4wade closed 1 month ago