mit-han-lab / smoothquant

[ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
https://arxiv.org/abs/2211.10438
MIT License
1.26k stars 150 forks source link

how to reproduce ppl of wikitext2? #67

Open Arthur-Ling opened 11 months ago

Arthur-Ling commented 11 months ago

Is there any demos for ppl test of wikitext2?

poedator commented 10 months ago

try examples from paperswithcode.com. For instance, see this repo https://github.com/ist-daslab/sparsegpt