Closed dat58 closed 2 months ago
This is an issue with TensorRT/ONNX Runtime's TensorRT EP and not something that can be fixed by ort
. Sorry.
This is an issue with TensorRT/ONNX Runtime's TensorRT EP and not something that can be fixed by
ort
. Sorry.
Hi @decahedron1, thank you for your reply. However, ort@2.0.0-rc.2 requires Onnxruntime version 1.17.x or higher and encounters issues with TensorRT. Could you please suggest a method for running TensorRT with ort@2.0.0-rc.2? For example, information about matching versions of Onnxruntime, CUDA, cuDNN, and TensorRT would be greatly appreciated.
Environment:
Then run:
Got errors:
Before ort@2.0.0-rc.2, I had used ort@1.16.3, and it worked perfectly. However, it did not provide async run. Has anyone else experienced this issue?