search

AnswerDotAI / fsdp_qlora

Training LLMs with QLoRA + FSDP
Apache License 2.0
1.39k stars 186 forks source link

Add arguments for reentrant_checkpointing & wandb #17

Closed warner-benjamin closed 6 months ago

warner-benjamin commented 6 months ago

Add arguments for reentrant_checkpointing and wandb, and performs an argument string update pass