search

LostRuins / koboldcpp

A simple one-file way to run various GGML and GGUF models with a KoboldAI UI
https://github.com/lostruins/koboldcpp
GNU Affero General Public License v3.0
4.41k stars 319 forks source link

There's an error when i run kobold.sh. 1.60.1 #741

Open maltmast opened 4 months ago

maltmast commented 4 months ago

otherarch/ggml_v3-cuda.cu(609): warning #177-D: function "warp_reduce_sum(half2)" was declared but never referenced

otherarch/ggml_v3-cuda.cu(630): warning #177-D: function "warp_reduce_max(half2)" was declared but never referenced

It repeats. Every second this warning shows in terminal. When I try to run koboldcpp.py it shows: *** Welcome to KoboldCpp - Version 1.60.1.yr0-ROCm An unexpected error occurred: [Errno 2] No such file or directory: '/opt/rocm/bin/rocminfo'

Can you fix this? Or tell me what i need to do?

LostRuins commented 4 months ago

The above are just warnings.

For the bottom one, you need to check with @YellowRoseCx

On mainline Kcpp rocminfo is optional, but YellowRose might have changed that in his fork.

YellowRoseCx commented 4 months ago

Its being worked on rn. Which distro of Linux are you on, where is your ROCm folder and where is your rocminfo folder?

maltmast commented 4 months ago

Its being worked on rn. Which distro of Linux are you on, where is your ROCm folder and where is your rocminfo folder?

It's in /opt/rocm. And rocminfo is in /opt/rocm/bin/rocminfo

maltmast commented 4 months ago

The above are just warnings.

For the bottom one, you need to check with @YellowRoseCx

On mainline Kcpp rocminfo is optional, but YellowRose might have changed that in his fork.

No, it still doesn't work.

YellowRoseCx commented 4 months ago

The above are just warnings.

For the bottom one, you need to check with @YellowRoseCx

On mainline Kcpp rocminfo is optional, but YellowRose might have changed that in his fork.

No, it still doesn't work.

You might wanna check your rocm install imo, running rocminfo shouldnt give an error if you say its in the spot its looking for it at

maltmast commented 4 months ago

I think this error is in make file. It doesn't make rocminfo and rocm folders.

maltmast commented 4 months ago

How can i get /opt/rocm folder and files which in it? Your program doesn't install it when i try to run installer.