ROCm (Fedora 40) - Githubissues

LostRuins / koboldcpp

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

https://github.com/lostruins/koboldcpp

GNU Affero General Public License v3.0

5.33k stars 363 forks source link

ROCm (Fedora 40) #1120

Open nexsus312 opened 2 months ago

nexsus312 commented 2 months ago

I have a 5700xt (gfx1010) and Fedora 40 (Nobara) the problem is that downloading ROCm through Nobara tool there is no TensileLibrary_lazy_gfx1010.dat I learned that you can rebuild Tensile but I have not succeeded ( build does not work in general). Has anyone encountered something like this and anyway is there any point in changing from Vulcan to ROCm. I have spent a lot of time on this, but nothing has worked.

Asherathe commented 2 months ago

I'm not on Fedora, but my distro also doesn't have all the files needed in the repo for building everything required. Vulcan works well for me, so I didn't see the point in putting a ridiculous amount of time into it.

will-deines commented 1 month ago

I'm not on Fedora but had to do some work to get ROCm working on a legacy Radeon card in linux. I installed directly from amd, instructions at: https://rocm.docs.amd.com/projects/radeon/en/latest/docs/install/native_linux/install-radeon.html