Does this support GGUF models? - Githubissues

Bip-Rep / sherpa

A mobile Implementation of llama.cpp

MIT License

281 stars 32 forks source link

Does this support GGUF models? #25

Open Kansi420 opened 8 months ago

Kansi420 commented 8 months ago

Does this support GGUF models?

danemadsen commented 8 months ago

The original devs have abandoned this project. Ive forked it can continued the work here:

https://github.com/Mobile-Artificial-Intelligence/maid

Yes, GGUF V1 and V2 models are supported

Dhruvanand24 commented 4 months ago

https://github.com/nerve-sparks/iris_android You can check this out. @Kansi420