RuntimeError with OpenVINOExecutionProvider on Windows when using ORTModelForSeq2SeqLM

[prasad-pr-20]

Environment Info:

• OS: Windows
• Optimum==1.22.0
• ONNX version==1.16.2
• Python version: 3.9.19
• ONNX Runtime version: 1.19.0
• onnxrumtime-openvino==1.14.0
• OpenVINO version: 2024.4.0

Issue Description I'm encountering a runtime error when trying to use the ORTModelForSeq2SeqLM class provided by Optimum-ONNX with the OpenVINOExecutionProvider. The issue arises when executing the following line of code: model_1 = ORTModelForSeq2SeqLM.from_pretrained("optimum/m2m100_418M", provider='OpenVINOExecutionProvider') The error message is as follows: RuntimeError: C:\Users\iei\Desktop\vishnu\wheel_build_after_doc_update\onnxruntime\onnxruntime\core\session\provider_bridge_ort.cc:1103 onnxruntime::ProviderLibrary::Get [ONNXRuntimeError] : 1 : FAIL : LoadLibrary failed with error 127 "" when trying to load "C:\Users\username\Downloads\path\path\open_vin\lib\site-packages\onnxruntime\capi\onnxruntime_providers_openvino.dll".

It's peculiar that the error message includes a different username in the file path, which does not match my machine's username.

Steps to Reproduce

• Enabled the OpenVINO environment using setvars.bat.
• Installed necessary packages with the following command: pip install onnx onnxruntime onnxruntime-openvino
• Confirmed that onnxruntime_providers_openvino.dll is present in the specified directory.

Additional Context

• I have successfully used DmlExecutionProvider and CPUExecutionProvider with the same setup.
• The goal is to run the model with OpenVINOExecutionProvider.

Any assistance in resolving this issue would be greatly appreciated.

[sfatimar]

It seems openvino is not installed ?

[prasad-pr-20]

OpenVINO is installed and the version is 2024.4.0.

[vthaniel]

The onnxruntime-openvino wheel version seems to be quite old "onnxruntime-openvino==1.14.0"

Can you use the latest one (1.19.0) and use OV2024.3 (latest onnxruntime-openvino version officially supports OV 2024.3)