search

mudler / LocalAI

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference
https://localai.io
MIT License
26.65k stars 1.99k forks source link

intel igpu not working #3382

Open maxvaneck opened 3 months ago

maxvaneck commented 3 months ago

ana 6.1.103-Unraid #1 SMP PREEMPT_DYNAMIC Fri Aug 9 00:11:30 PDT 2024 x86_64 11th Gen Intel(R) Core(TM) i5-11400 @ 2.60GHz GenuineIntel GNU/Linux with 64 GigaBamboozle of wham

gpu = RocketLake-S GT1 [UHD Graphics 730]

Describe the bug the gpu does work as shown by llama-cpp -avx2 showing up in intel_gpu_top but there is almost no usage and seems to process forever

To Reproduce go to the unraid "appstore" choose the latest intel gpu-aio-f16 image and passthrough /dev/dri as a device

Expected behavior the same experience as the cpu only image only faster

Logs logs are attached logs.txt

Additional context i 'm using this to flesh out dnd characters and 30 secs per prompt makes it take ages

thx in advance Max

maxvaneck commented 3 months ago

looking a bit into it. it seems to be related to #3076

maxvaneck commented 3 months ago

unraid 7 should enable my arc a750 so i'm also hoping that'll work

ignas2526 commented 2 months ago

I'm having exact same issue with Intel(R) Xeon(R) E-2378G CPU @ 2.80GHz; gpu is Intel® UHD Graphics P750.

maxvaneck commented 2 months ago

i have also tried the vulkan container . doesn't work either