search

henk717 / KoboldAI

KoboldAI is generative AI software optimized for fictional use, but capable of much more!
http://koboldai.com
GNU Affero General Public License v3.0
359 stars 130 forks source link

GPTQ support for IPEX #468

Closed Disty0 closed 11 months ago

Disty0 commented 11 months ago

GPTQ works on the GPU but it's really slow. Still no Bitsandbytes.