AnswerDotAI / fsdp_qlora

Training LLMs with QLoRA + FSDP
Apache License 2.0
1.42k stars 188 forks source link

Scaling experiments #12

Closed KeremTurgutlu closed 8 months ago

KeremTurgutlu commented 8 months ago
warner-benjamin commented 8 months ago

Closing per discussion with @KeremTurgutlu, as the HQQ changes are also in #14.