search

lshqqytiger / ZLUDA

CUDA on AMD GPUs
Apache License 2.0
270 stars 35 forks source link

The latest version of Ollama cannot accelerate with zluda #16

Closed 4thanks closed 4 months ago

4thanks commented 4 months ago

I successfully run Zluda to accelerate Ollama in version 0.1.32 follow the steps ollama_windows_10_rx6600xt_zluda, but today update to the latest version 0.1.35, redo to copy cublas.dll from zluda folder to "\AppData\Local\Programs\Ollama, and rename cublas.dll to cublas64_11.dll, only the CPU is computing, gpu not running.

I tried downgrading to version 0.1.34, which didn't work; downgrading to version 0.1.33 works.

4thanks commented 4 months ago

add HSA_OVERRIDE_GFX_VERSION=10.3.0 environment variables, and start with zluda ollama.exe serve, not zluda ollama app.exe serve, my gpu running again!