-
Greetings, @cipher982!
Currently we are working on the Openvino inference framework, and such benchmarks are critical to understand gaps and differences between our framework and Transformers/ TGI …
-
What could be the problem, please help..
Thank you
-
### Request Description
PagedAttention operation is already [implemented](https://github.com/openvinotoolkit/openvino/blob/9c41f10ef4c472b7434da62931c71201732fb3f8/src/plugins/intel_cpu/src/nodes/p…
-
NPU is failing with OpenVINO 2024.3 + NPU driver 1.6.0 using Resnet50 v1.5 model and OpenVINO benchmark app. Worked previously with OpenVINO 2024.2 and NPU driver 1.2. ASUS NUC 14 Pro, Intel(R) Core…
-
### Your current environment
```text
Collecting environment information...
WARNING 09-26 20:43:46 _custom_ops.py:18] Failed to import from vllm._C with ModuleNotFoundError("No module named 'vllm.…
-
# 硬件型号
11th Gen Intel(R) Core(TM) i5-1135G7 @ 2.40GHz 2.42 GHz,集成显卡 Iris
# 问题现象
## 使用 gpu 推理结果如下
![image](https://github.com/user-attachments/assets/119b501d-bbca-4c54-a9f0-e5a337afb0a8)
##…
-
### OpenVINO Version
2024.3
### Operating System
Windows System
### Device used for inference
NPU
### Framework
ONNX
### Model used
Mobilenetv3
### Issue description
M…
-
https://github.com/openvinotoolkit/openvino/blob/e581a0ff6a95ab60078bd0a93226764dfd9e9bcf/src/core/src/op/shape_of.cpp#L36C1-L37C1
Dear OpenVINO Development Team,
I encountered a compilation i…
-
### OpenVINO Version
2024.3
### Operating System
Ubuntu 20.04 (LTS)
### Device used for inference
GPU
### Framework
None
### Model used
TinyLlama/TinyLlama-1.1B-Chat-v1.0
### Issue descripti…
-
Hi,
I know this is not directly related, however I am trying to call a macro that will remove noise from an audiofile using OpenVino in Audacity using PowerShell. However, it seems that given the s…