search

ikawrakow / ik_llama.cpp

llama.cpp fork with additional SOTA quants and improved performance
MIT License
89 stars 6 forks source link

Adding IQ2_K, IQ3_K and IQ5_K #7

Closed ikawrakow closed 3 months ago

ikawrakow commented 3 months ago

See this discussion for rationale.