How is code replication in SparseGPT going?

NolanoOrg / sparse_quant_llms

SparseGPT + GPTQ Compression of LLMs like LLaMa, OPT, Pythia

41 stars 3 forks source link

Open thaumstrial opened 1 year ago

thaumstrial commented 1 year ago

Your project are really helpful! I am also trying to reproduce SparseGPT: https://arxiv.org/pdf/2301.00774.pdf

Does the SparseGPT you tried work?

Ayushk4 commented 1 year ago

The authors have released the code at: https://github.com/IST-DASLab/sparsegpt You may use that.

thaumstrial commented 1 year ago

Thanks! It helps me a lot!