Open jjxyai opened 1 month ago
Check your dll function api right, or use static plugin.
dumpbin /exports ./plugin_lib.dll
getCreators
(previously known as getPluginCreators
) has to be implemented in the plugin shared library if you want to use trtexec --dynamicPlugins
.
yes, this is documented in https://docs.nvidia.com/deeplearning/tensorrt/developer-guide/index.html#generating-plugin-library, will close this, thanks all!
https://docs.nvidia.com/deeplearning/tensorrt/developer-guide/index.html#generating-plugin-library
No, it did not say it is a must for trtexec.
https://docs.nvidia.com/deeplearning/tensorrt/developer-guide/index.html#generating-plugin-library
No, it did not say it is a must for trtexec.
This is a must if you want your plugin work with the version compatibility feature. However, I reopen this created internal issue to track the document update for this.
getCreators
(previously known asgetPluginCreators
) has to be implemented in the plugin shared library if you want to use trtexec--dynamicPlugins
.
solved by adding methods mentioned in 9.9.1. Generating Plugin Shared Libraries
thanks a lot!!
Description
convert onnx to engine with trtexec:
trtexec --onnx=model.onnx --dynamicPlugins=plugin_lib.dll --saveEngine=model16.engine --fp16 --allowGPUFallback
with error output:
Environment
TensorRT Version:8.6
NVIDIA GPU:4060
NVIDIA Driver Version:546.92
CUDA Version:12.3
CUDNN Version:8.9
Operating System:win11