search

LostRuins / koboldcpp

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
https://github.com/lostruins/koboldcpp
GNU Affero General Public License v3.0
5.04k stars 352 forks source link

ROCm (Fedora 40) #1120

Open nexsus312 opened 1 month ago

nexsus312 commented 1 month ago

I have a 5700xt (gfx1010) and Fedora 40 (Nobara) the problem is that downloading ROCm through Nobara tool there is no TensileLibrary_lazy_gfx1010.dat I learned that you can rebuild Tensile but I have not succeeded ( build does not work in general). Has anyone encountered something like this and anyway is there any point in changing from Vulcan to ROCm. I have spent a lot of time on this, but nothing has worked.

Asherathe commented 4 weeks ago

I'm not on Fedora, but my distro also doesn't have all the files needed in the repo for building everything required. Vulcan works well for me, so I didn't see the point in putting a ridiculous amount of time into it.

will-deines commented 2 days ago

I'm not on Fedora but had to do some work to get ROCm working on a legacy Radeon card in linux. I installed directly from amd, instructions at: https://rocm.docs.amd.com/projects/radeon/en/latest/docs/install/native_linux/install-radeon.html