search

LostRuins / koboldcpp

A simple one-file way to run various GGML and GGUF models with KoboldAI's UI
https://github.com/lostruins/koboldcpp
GNU Affero General Public License v3.0
4.36k stars 312 forks source link

I wish there was a function to search for available models in koboldcpp. #808

Open kbuwel opened 2 months ago

kbuwel commented 2 months ago

Faraday has a function to display and download available models, but koboldcpp only has a function to load models directly. It would be nice to have a function to search for available models.

LostRuins commented 2 months ago

It's quite easy since almost any GGUF file will work. You can find them on huggingface. https://huggingface.co/

Just search GGUF

kbuwel commented 2 months ago

I know the gguf model works. However, it is cumbersome to find which gguf file I want.

Woisek commented 2 months ago

I know the gguf model works. However, it is cumbersome to find which gguf file I want.

And you think this changes if you change the program with which you search for ... ? 🤪

henk717 commented 1 month ago

I have been considering solving this in a different way where we use our WIP website to link to popular models. That way we dont introduce a dependency on Huggingface.