lmstudio-ai / lms

LM Studio CLI. Written in TypeScript/Node
https://lms.dev
MIT License
1.09k stars 84 forks source link

Is there a plan to support NPU? #30

Open miracle777 opened 1 month ago

miracle777 commented 1 month ago

Snapdragon X Elite and Core Ultra have NPUs built-in. However, it seems that the capabilities of the NPU can only be utilized with software that supports it. Does LM Studio have any plans to support these NPUs?

With the new Copilot+PC standard computers, the GPU is integrated into the CPU, and the VRAM shares memory with the main RAM. As a result, the graphics capability is a concern compared to laptops with NVIDIA GPUs. Therefore, even though these computers are touted as AI-ready, some use NPUs instead of GPUs. It would be very helpful if LM Studio could also support NPUs.

vip7009pro commented 2 weeks ago

same question