LostRuins / koboldcpp

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
https://github.com/lostruins/koboldcpp
GNU Affero General Public License v3.0
4.66k stars 334 forks source link

ROCM exe can't find hipblas.dll in TEMP file when run #707

Open shankasc opened 6 months ago

shankasc commented 6 months ago

The 1.58 .exe for ROCM doesn't seem to be building correctly when run:

image

Running on a 6600 XT to test the new compatibility update, unsure is this is a pytorch issue or something else

henk717 commented 6 months ago

Which CPU is this with? This error is often caused if AVX2 is missing from the CPU.

shankasc commented 6 months ago

I'm working with a 5800X, which should support AVX2