search

LostRuins / koboldcpp

A simple one-file way to run various GGML and GGUF models with KoboldAI's UI
https://github.com/lostruins/koboldcpp
GNU Affero General Public License v3.0
4.35k stars 312 forks source link

Update llama.cpp for Phi 3 support #860

Closed tdisheng closed 1 month ago

tdisheng commented 1 month ago

Hi, Phi 3 Medium 128K GGUF only works with latest version of llama. Possible to update for koboldcpp?

See: https://github.com/ggerganov/llama.cpp/commit/201cc11afa0a1950e1f632390b2ac6c937a0d8f0

LostRuins commented 1 month ago

Yes, there will be a release by the end of the week.

LostRuins commented 1 month ago

Hi, new version is now released.