foundation-model-stack / fms-acceleration

🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.
Apache License 2.0
0 stars 4 forks source link

Upstream Main: Fused Ops and Kernels, FSDP and Memory Fixes #35

Closed fabianlim closed 3 weeks ago

fabianlim commented 3 weeks ago

This PR enables