search

LostRuins / koboldcpp

A simple one-file way to run various GGML and GGUF models with a KoboldAI UI
https://github.com/lostruins/koboldcpp
GNU Affero General Public License v3.0
4.41k stars 319 forks source link

cublast old cpu supprot #755

Open Loko415 opened 3 months ago

Loko415 commented 3 months ago

add old cpu support cu blast because cl blast is slower.

Tacx79 commented 3 months ago

Cublas works only on nvidia cards ('cu' in the name is from CUDA, 'cl' is from OpenCL which works on all gpus and cpus)

Loko415 commented 3 months ago

Cublas works only on nvidia cards ('cu' in the name is from CUDA, 'cl' is from OpenCL which works on all gpus and cpus)

i do have cublast?

henk717 commented 3 months ago

Give Vulkan a try, its much faster than CLBlast.