DirectML is a high-performance, hardware-accelerated DirectX 12 library for machine learning. DirectML provides GPU acceleration for common machine learning tasks across a broad range of supported hardware and drivers, including all DirectX 12-capable GPUs from vendors such as AMD, Intel, NVIDIA, and Qualcomm.
use win debug see that the system is doing TryCreateCompiledOperator (see attached picture)
No matter use Nvida 3080TI or AMD 7900XTX, the problem is same.
Describe the issue When use test data to do ort.InferenceSession, takes time and not exit
To reproduce use the onnx file put in google drive https://drive.google.com/file/d/1y-evMcenYe-Q0JpyQvuwO0YHBX8gSSBE/view?usp=sharing import numpy as np import onnxruntime as ort
EP_list = ['DmlExecutionProvider'] sess_opt = ort.SessionOptions() sess_opt.log_severity_level = 0 sess_opt.graph_optimization_level = ort.GraphOptimizationLevel.ORT_ENABLE_BASIC sess = ort.InferenceSession("text_encoder_3.onnx", sess_opt, providers=EP_list)
use win debug see that the system is doing TryCreateCompiledOperator (see attached picture) No matter use Nvida 3080TI or AMD 7900XTX, the problem is same.