openpsi-project / ReaLHF

Super-Efficient RLHF Training of LLMs with Parameter Reallocation
Apache License 2.0
114 stars 4 forks source link

Fix mistral model conversion #51

Closed garrett4wade closed 2 months ago

garrett4wade commented 2 months ago

.