search

microsoft / onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
https://onnxruntime.ai
MIT License
14.83k stars 2.94k forks source link

How to include libnvinfer_plugin in trt_extra_plugin_lib_paths on Windows? Im using python. #22521

Open auggieFT opened 1 month ago

auggieFT commented 1 month ago

Describe the issue

How to include libnvinfer_plugin in trt_extra_plugin_lib_paths on Windows? Im using python. And with that i want to include efficient NMS plugin.

To reproduce

ort_session = ort.InferenceSession(model_onnx, providers=[('TensorrtExecutionProvider', { 'trt_extra_plugin_lib_paths': "libnvinfer_plugin.dll" }), ])

this does not work. Also it doesnt work when i pass absolute path of nvinfer_plugin_10.dll to trt_extra_plugin_lib_paths.

Urgency

No response

Platform

Windows

OS Version

19045

ONNX Runtime Installation

Released Package

ONNX Runtime Version or Commit ID

1.19.1

ONNX Runtime API

Python

Architecture

X64

Execution Provider

TensorRT

Execution Provider Library Version

Tensorrt 10.5

github-actions[bot] commented 1 week ago

This issue has been automatically marked as stale due to inactivity and will be closed in 30 days if no further activity occurs. If further support is needed, please provide an update and/or more details.