Fix bug and D < 128 case for Q8_0 k-cache - Githubissues

ikawrakow / ik_llama.cpp

llama.cpp fork with additional SOTA quants and improved performance

MIT License

89 stars 6 forks source link

Fix bug and D < 128 case for Q8_0 k-cache #52

Closed ikawrakow closed 1 month ago