search

foundation-model-stack / fms-acceleration

🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.
Apache License 2.0
0 stars 4 forks source link

Allow AutoGPTQ to work in low cpu memory mode #18

Closed fabianlim closed 1 month ago

fabianlim commented 1 month ago

It is documented here the challenges now on why it doesnt work,

Will be good to address this.

fabianlim commented 1 month ago

We are going with a workaround #26 first