Closed Astlaan closed 3 hours ago
"AMD Radeon(TM) Graphics" gfx=gfx1035 "AMD Radeon RX 6700S" gfx=gfx1032 time=2024-10-26T14:35:44.587+01:00 level=DEBUG source=amd_windows.go:146 msg="amdgpu is supported" gpu=1 gpu_type=gfx1032
This happens due to the libs avialble at seperately withgfx1035 and gfx1032 . Dy set HIP_VISIBLE_DEVICE=1,0...(to defind the card using ).otherwise ,need to rebuild the rocmlibs for gfx1032 and gfx1035 together which will enable both dgpu and igup .ie gfx1032 and gfx1035 together .
Also there is possible Navida drivers conflicts issue .searching for GPU discovery libraries for NVIDIA" time=2024-10-26T14:35:43.531+01:00 level=DEBUG source=gpu.go:505 msg="Searching for GPU library" name=nvml.dll
Thank you. In the end I ended up closing because I had made a mistake, I had simply failed to copy the rocblas.dll
file as well (only copies the TensileLibrary files).
It worked fine for me in the end. No need to copy rocblas.dll
and the rocblas
folder to the runners/roc....
great .nice try.
What is the issue?
My hardware is: CPU: AMD 6800HS GPU: AMD 6700S (Corresponds to gfx1032, from what I can tell)
1) I installed your Ollama for AMD latest release on Windows. 2) I downloaded the 1032 Freemont Dango option from https://github.com/likelovewant/ROCmLibs-for-gfx1103-AMD780M-APU/releases/tag/v0.6.1.2. 3) I extracted and substituted the library folder in
AppData\Local\Programs\Ollama\lib\ollama\rocblas
4) I set the debug environment variable with$env:OLLAMA_DEBUG = "1"
5) I runollama serve
, and get:So the GPU seems to be detected and supported. However, when I try to run
ollama run llama3.2:1b
I get:Can you help?
OS
Windows
GPU
AMD
CPU
AMD
Ollama version
0.3.14-0-gc692dfd