Closed hkfuertes closed 5 months ago
Hi @hkfuertes,
Unfortunately your APU (gfx90c) is not currently supported in ROCm. You can take a look at the supported GPUs in the ROCM 6.0.2 Documentation.
Some people have had some success using the environment variable export HSA_OVERRIDE_GFX_VERSION=9.0.0
on similar devices, although running your card with this isn't officially supported.
I hope this helps, let me know if you have further questisons. Daine
Hello, oooh, thank you! I tested it and ollama gives me answers... I need to test if this is faster than CPU, but is a start :)
Thank you for the help, and I understand that this usecase is more suitable for a discrete graphic card.
Hello, Im trying to run ollama through the gpu but I get this error:
Is my card not supported? Thank you in advance.
PS: Ryzen 7 APU (5800H) Mini PC