search

foundation-model-stack / fms-acceleration

🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.
Apache License 2.0
0 stars 4 forks source link

Fix FSDP casting issue for Autogptq and Fused Ops #28

Closed fabianlim closed 1 month ago

fabianlim commented 1 month ago

This fixes the FSDP issue for GPTQ-LORA and Fused Ops raised in #25

fabianlim commented 1 month ago

I did not lint. Will lint when I make the next PR. the failures are quite minor

+--------------------+------------+
|message id          |occurrences |
+====================+============+
|trailing-whitespace |2           |
+--------------------+------------+
|import-error        |1           |
+--------------------+------------+