Closed Disty0 closed 11 months ago
GPTQ works on the GPU but it's really slow. Still no Bitsandbytes.
GPTQ works on the GPU but it's really slow. Still no Bitsandbytes.