Bip-Rep / sherpa

A mobile Implementation of llama.cpp
MIT License
281 stars 32 forks source link

Support for GGMLv3? #26

Open trignomtry opened 6 months ago

trignomtry commented 6 months ago

The newest llama.cpp provides a new ggml encoding format, and no modern models support this version. Can you update the llama.cpp version? Thank you!

danemadsen commented 6 months ago

The newest llama.cpp provides a new ggml encoding format, and no modern models support this version. Can you update the llama.cpp version? Thank you!

They've abandoned it, Ive continued the work over here

https://github.com/Mobile-Artificial-Intelligence/maid