issues
search
foundation-model-stack
/
fms-acceleration
🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.
Apache License 2.0
0
stars
4
forks
source link
Upstream Main: Fused Ops and Kernels, FSDP and Memory Fixes
#35
Closed
fabianlim
closed
3 weeks ago
fabianlim
commented
3 weeks ago
This PR enables
Implementing Fused Ops and Kernels with Model Patcher #25
FSDP fixes with Fused Ops #28, #31
fixes low mem mode for GPTQ-LoRA #26
benchmarking script fixes #26, #30
This PR enables