search

alibaba / FederatedScope

An easy-to-use federated learning platform
https://www.federatedscope.io
Apache License 2.0
1.3k stars 210 forks source link

Dev/llm #647

Closed HarliWu closed 1 year ago

HarliWu commented 1 year ago
  1. Some bugs have been fixed for /llm/offsite_tuning/. Specifically, the keys of "emulator and adapter" mismatch that of the raw model.
  2. Also, we optimize the RAM usage of the training of the offsite-tuning.
  3. Support the loading of offsite_tuning model in FSChatBot
rayrayraykk commented 1 year ago

Close as the PR is in #649 .