-
Hi, Does Katago can use new intel ultra CPU's NPU? Or, is there any advantage of NPU?
-
Hello.
Thank you for launching such a project.
I have a few questions
I guess you still haven't found a way to utilize the npu in the device and if we try to generate more than 400x400 pixels,…
Lyk5t updated
10 hours ago
-
Support Ascend 910b NPU:
- fastfetch
- llama-box
- gpustack
-
Hi Guys,
Wanted to ask does this supports proper NPU ? for llm loading and processing?
-
**Describe the bug**
When attempting to compile the YOLOv8 model using the NPU, a RuntimeError occurs.
```
---------------------------------------------------------------------------
RuntimeErro…
-
Is it possible to compile a model using the latest NPU driver and OpenVINO version for the NPU 3400 (Keem Bay)? If so, are there any special guidelines?
-
我的测试脚本:
```
NPROC_PER_NODE=8 \
ASCEND_RT_VISIBLE_DEVICES=0,1,2,3,4,5,6,7 \
HCCL_SOME_VARIABLE=value
swift infer \
--model_type '/data2/dxc/Qwen1.5-32B-Chat' \
--load_args_from_ckpt_dir …
-
Hello, would that be possible to also have the NPU usage ?
I have a 7840U, let me know if you need anything
More info:
- https://videocardz.com/newz/amd-ryzen-8040-neural-processing-unit-monit…
-
### Prerequisites
- [X] I am running the latest code. Mention the version if possible as well.
- [X] I carefully followed the [README.md](https://github.com/ggerganov/llama.cpp/blob/master/README.md)…
-
It would be even better if later versions could add support for npu modules