Can SmoothQuant be used on ViT models?

mit-han-lab / smoothquant

[ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

https://arxiv.org/abs/2211.10438

MIT License

1.26k stars 150 forks source link

Can SmoothQuant be used on ViT models? #86

Open n9s8a opened 7 months ago

n9s8a commented 7 months ago

Hi Team,

I hope this massage finds you well.

I want to use same method to compress OWLv2 model. can this method be used to compress ViT models? if yes how we can do that? What changes need to be made in the existing code?

Thank you for considering this request. I look forward to any updates or information you can provide on this matter.