search

microsoft / onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
https://onnxruntime.ai
MIT License
14.77k stars 2.94k forks source link

[TensorRT EP] Exclude DDS ops from running on TRT #22875

Closed chilo-ms closed 3 days ago

chilo-ms commented 3 days ago

TRT EP excludes DDS ops from running on TRT and doesn't allow users to change. This PR is for ORT 1.20.1 patch release.

We will have better solution to add a new provider option to exclude specific ops, similar to following: https://github.com/microsoft/onnxruntime/pull/22863 https://github.com/microsoft/onnxruntime/pull/22681