Open henryruhs opened 1 week ago
Inferencing from OpenVINO depends on the available devices on your system- 'GPU.0' is equivalent to 'GPU' and 'GPU.1' can only be used if an additional dGPU driver is available on your system. Kindly use the latest release of OVEP and make sure your GPU drivers are updated and can be read by OpenVINO.
This does not explain this error:
[OpenVINO] Specified device - GPU.0 is not available
Describe the issue
Many users reach out that
GPU.0
,GPU.1
etc. is not working for them when creating a InferenceSession. According to the documentation this should work - but in fact onlyGPU
does, which should just be an alias toGPU.0
A user with an Intel Arc 770 send me this, his device id is 0.
To reproduce
We found this script to debug his graphics card.
He then send me his output.
It seems this is an issue on OpenVINO's API itself or that different drivers return different information? Anyways, it could be resolved on the onnxruntime level bei hardcoding
GPU.0
toGPU
.Urgency
High priority as this breaks apps.
Platform
Windows
OS Version
11
ONNX Runtime Installation
Released Package
ONNX Runtime Version or Commit ID
1.19.0
ONNX Runtime API
Python
Architecture
X64
Execution Provider
OpenVINO
Execution Provider Library Version
Used with OpenVino 2024.3.0