bfp full block quantization - algo 3

IST-DASLab / gptq

Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".

https://arxiv.org/abs/2210.17323

Apache License 2.0

1.91k stars 152 forks source link

Closed isoloveychik closed 1 year ago