full weights fsdp training seems broken with fsdp_cpu_ram_efficient_loading - Githubissues

axolotl-ai-cloud / axolotl

Go ahead and axolotl questions

https://axolotl-ai-cloud.github.io/axolotl/

Apache License 2.0

7.48k stars 808 forks source link

full weights fsdp training seems broken with fsdp_cpu_ram_efficient_loading #1726

Closed winglian closed 2 months ago