ikawrakow / ik_llama.cpp

llama.cpp fork with additional SOTA quants and improved performance
MIT License
89 stars 6 forks source link

AVX2 quantization for Q8_K #22

Closed ikawrakow closed 2 months ago

ikawrakow commented 2 months ago

It has been there for a while, but forgot to add here.