Open chris-hatton opened 3 weeks ago
@chris-hatton looks something behind the scenes is happening - care to share dmesg when that happens?
Also, why using REBUILD
? The image should have already binaries for the CPU flagset variants, including non-AVX - did you tried to disable it? your GPU seems also covered by defaults GPU_TARGETS
LocalAI version: Using Docker image:
localai/localai:latest-aio-gpu-hipblas
Environment, CPU architecture, OS, and Version:
gfx1031
but I've seen this to begfx1030
compatible on a previous ROCm test)6.2.60200
)Describe the bug
To Reproduce
Expected behavior LocalAI starts and serves an interface on the exposed host port 8082, ready to run inference on the AMD card.
Logs The last lines of the startup/rebuild log, before the exit, are: