I can't seem to load any models with the ROCm fork on my 6600xt.
With "Use QuantMalMut (mmq)" ticked, I get;
CUDA error: named symbol not found
current device: 0, in function ggml_cuda_op_mul_mat at D:/a/koboldcpp-rocm/koboldcpp-rocm/ggml-cuda.cu:9464
hipGetLastError()
GGML_ASSERT: D:/a/koboldcpp-rocm/koboldcpp-rocm/ggml-cuda.cu:241: !"CUDA error"
Without mmq ticked, the browser launches, but any attempt at generation results in nonsense;
I can't seem to load any models with the ROCm fork on my 6600xt.
With "Use QuantMalMut (mmq)" ticked, I get;
Without mmq ticked, the browser launches, but any attempt at generation results in nonsense;