How Can I Peft the Smoothquanted LLM?

mit-han-lab / smoothquant

[ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

https://arxiv.org/abs/2211.10438

MIT License

1.1k stars 127 forks source link

Open LameloBally opened 4 months ago

LameloBally commented 4 months ago

I want to know how to use LoRA mehthod to SmoothQuant LLM

RanchiZhao commented 2 months ago

same issue, is this available?