search

ROCm / rocBLAS

Next generation BLAS implementation for ROCm platform
https://rocm.docs.amd.com/projects/rocBLAS/en/latest/
Other
336 stars 157 forks source link

gfx90c #1398

Closed hkfuertes closed 5 months ago

hkfuertes commented 5 months ago

Hello, Im trying to run ollama through the gpu but I get this error:

rocBLAS error: Cannot read /opt/rocm/lib/rocblas/library/TensileLibrary.dat: Illegal seek for GPU arch : gfx90c

Is my card not supported? Thank you in advance.

PS: Ryzen 7 APU (5800H) Mini PC

daineAMD commented 5 months ago

Hi @hkfuertes,

Unfortunately your APU (gfx90c) is not currently supported in ROCm. You can take a look at the supported GPUs in the ROCM 6.0.2 Documentation.

Some people have had some success using the environment variable export HSA_OVERRIDE_GFX_VERSION=9.0.0 on similar devices, although running your card with this isn't officially supported.

I hope this helps, let me know if you have further questisons. Daine

hkfuertes commented 5 months ago

Hello, oooh, thank you! I tested it and ollama gives me answers... I need to test if this is faster than CPU, but is a start :)

Thank you for the help, and I understand that this usecase is more suitable for a discrete graphic card.