search

LostRuins / koboldcpp

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
https://github.com/lostruins/koboldcpp
GNU Affero General Public License v3.0
5.14k stars 353 forks source link

[Request] Run safetensors model WizardLM on koboldcpp #230

Closed nidjan closed 1 year ago

nidjan commented 1 year ago

Please say me. how to, if it maybe, run or convert https://huggingface.co/TheBloke/WizardLM-30B-Uncensored-GPTQ model

cgessai commented 1 year ago

You need the GGML version. Try here: https://huggingface.co/TheBloke/WizardLM-30B-Uncensored-GGML

nidjan commented 1 year ago

thank you :)