search

microsoft / onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
https://onnxruntime.ai
MIT License
14.77k stars 2.94k forks source link

[TensorRT EP] Exclude DDS ops from running on TRT #22874

Closed chilo-ms closed 3 days ago

chilo-ms commented 3 days ago

TRT EP excludes DDS ops from unning on TRT and doesn't allow users to change. This PR is for ORT 1.20.1 patch release.

We will have better solution to add a new provider option to exclude specific ops, similar to following: https://github.com/microsoft/onnxruntime/pull/22863 https://github.com/microsoft/onnxruntime/pull/22681