openpsi-project / ReaLHF

Super-Efficient RLHF Training of LLMs with Parameter Reallocation
Apache License 2.0
114 stars 4 forks source link

Automatic importing can be problematic if the parent directory contains "realhf". #58

Closed garrett4wade closed 1 month ago

garrett4wade commented 2 months ago

The automatic importing may fail due to improper string matching. It should be fine within our docker image though.

Assigned to @jwhj.