search

ikawrakow / ik_llama.cpp

llama.cpp fork with additional SOTA quants and improved performance
MIT License
89 stars 6 forks source link

Merge mainline - Aug 12 2024 #17

Closed ikawrakow closed 2 months ago

ikawrakow commented 2 months ago

Mainly for the LLaMA-3.1 RoPE related changes, not much else of interest.

Mainline commit hash: 4134999e01f31256b15342b41c4de9e2477c4a6c