search

eweill-nv / dcnv2_trt

TensorRT plugin forDCNv2 layer in ONNX model
Apache License 2.0
57 stars 13 forks source link

buildEngineWithConfig() get error of Plugin Op DCNv2_TRT #3

Open urbaneman opened 3 years ago

urbaneman commented 3 years ago

Hi, @eweill-nv,thanks for your work. I'm try to register the "DCNv2_TRT" layer with your code. It register sucessful, however got the error of "DCNv2_TRT" in parser onnx:

----------------------------------------------------------------
Input filename:   ./models/dladcnv2_o_trt.onnx
ONNX IR version:  0.0.7
Opset version:    9
Producer name:
Producer version:
Domain:
Model version:    0
Doc string:
----------------------------------------------------------------
ERROR: C:\source\rtExt\cuda\cudaPluginV2DynamicExtRunner.cpp (108) - Cuda Error in nvinfer1::rt::cuda::PluginV2DynamicExtRunner::execute: 9 (invalid configuration argument)
WARNING: Get cuda error during getBestTactic: (Unnamed Layer* 176) [PluginV2DynamicExt]
ERROR: C:\source\rtExt\cuda\cudaPluginV2DynamicExtRunner.cpp (108) - Cuda Error in nvinfer1::rt::cuda::PluginV2DynamicExtRunner::execute: 9 (invalid configuration argument)
WARNING: Get cuda error during getBestTactic: (Unnamed Layer* 176) [PluginV2DynamicExt]
ERROR: C:\source\rtExt\cuda\cudaPluginV2DynamicExtRunner.cpp (108) - Cuda Error in nvinfer1::rt::cuda::PluginV2DynamicExtRunner::execute: 9 (invalid configuration argument)
WARNING: Get cuda error during getBestTactic: (Unnamed Layer* 176) [PluginV2DynamicExt]
ERROR: C:\source\rtExt\cuda\cudaPluginV2DynamicExtRunner.cpp (108) - Cuda Error in nvinfer1::rt::cuda::PluginV2DynamicExtRunner::execute: 9 (invalid configuration argument)
WARNING: Get cuda error during getBestTactic: (Unnamed Layer* 176) [PluginV2DynamicExt]
ERROR: C:\source\rtExt\cuda\cudaPluginV2DynamicExtRunner.cpp (108) - Cuda Error in nvinfer1::rt::cuda::PluginV2DynamicExtRunner::execute: 9 (invalid configuration argument)
WARNING: Get cuda error during getBestTactic: (Unnamed Layer* 176) [PluginV2DynamicExt]
ERROR: C:\source\rtExt\cuda\cudaPluginV2DynamicExtRunner.cpp (108) - Cuda Error in nvinfer1::rt::cuda::PluginV2DynamicExtRunner::execute: 9 (invalid configuration argument)
WARNING: Get cuda error during getBestTactic: (Unnamed Layer* 176) [PluginV2DynamicExt]
ERROR: C:\source\rtExt\cuda\cudaPluginV2DynamicExtRunner.cpp (108) - Cuda Error in nvinfer1::rt::cuda::PluginV2DynamicExtRunner::execute: 9 (invalid configuration argument)
WARNING: Get cuda error during getBestTactic: (Unnamed Layer* 176) [PluginV2DynamicExt]
ERROR: C:\source\rtExt\cuda\cudaPluginV2DynamicExtRunner.cpp (108) - Cuda Error in nvinfer1::rt::cuda::PluginV2DynamicExtRunner::execute: 9 (invalid configuration argument)
WARNING: Get cuda error during getBestTactic: (Unnamed Layer* 176) [PluginV2DynamicExt]
ERROR: C:\source\rtExt\cuda\cudaPluginV2DynamicExtRunner.cpp (108) - Cuda Error in nvinfer1::rt::cuda::PluginV2DynamicExtRunner::execute: 9 (invalid configuration argument)
WARNING: Get cuda error during getBestTactic: (Unnamed Layer* 176) [PluginV2DynamicExt]
ERROR: C:\source\rtExt\cuda\cudaPluginV2DynamicExtRunner.cpp (108) - Cuda Error in nvinfer1::rt::cuda::PluginV2DynamicExtRunner::execute: 9 (invalid configuration argument)
WARNING: Get cuda error during getBestTactic: (Unnamed Layer* 176) [PluginV2DynamicExt]
ERROR: C:\source\rtExt\cuda\cudaPluginV2DynamicExtRunner.cpp (108) - Cuda Error in nvinfer1::rt::cuda::PluginV2DynamicExtRunner::execute: 9 (invalid configuration argument)
WARNING: Get cuda error during getBestTactic: (Unnamed Layer* 176) [PluginV2DynamicExt]
ERROR: C:\source\rtExt\cuda\cudaPluginV2DynamicExtRunner.cpp (108) - Cuda Error in nvinfer1::rt::cuda::PluginV2DynamicExtRunner::execute: 9 (invalid configuration argument)
WARNING: Get cuda error during getBestTactic: (Unnamed Layer* 176) [PluginV2DynamicExt]
ERROR: C:\source\rtExt\cuda\cudaPluginV2DynamicExtRunner.cpp (108) - Cuda Error in nvinfer1::rt::cuda::PluginV2DynamicExtRunner::execute: 9 (invalid configuration argument)
WARNING: Get cuda error during getBestTactic: (Unnamed Layer* 176) [PluginV2DynamicExt]
ERROR: C:\source\rtExt\cuda\cudaPluginV2DynamicExtRunner.cpp (108) - Cuda Error in nvinfer1::rt::cuda::PluginV2DynamicExtRunner::execute: 9 (invalid configuration argument)
WARNING: Get cuda error during getBestTactic: (Unnamed Layer* 176) [PluginV2DynamicExt]
ERROR: C:\source\rtExt\cuda\cudaPluginV2DynamicExtRunner.cpp (108) - Cuda Error in nvinfer1::rt::cuda::PluginV2DynamicExtRunner::execute: 9 (invalid configuration argument)
WARNING: Get cuda error during getBestTactic: (Unnamed Layer* 176) [PluginV2DynamicExt]
ERROR: C:\source\rtExt\cuda\cudaPluginV2DynamicExtRunner.cpp (108) - Cuda Error in nvinfer1::rt::cuda::PluginV2DynamicExtRunner::execute: 9 (invalid configuration argument)
WARNING: Get cuda error during getBestTactic: (Unnamed Layer* 176) [PluginV2DynamicExt]
ERROR: Try increasing the workspace size with IBuilderConfig::setMaxWorkspaceSize() if using IBuilder::buildEngineWithConfig, or IBuilder::setMaxWorkspaceSize() if using IBuilder::buildCudaEngine.
ERROR: C:\source\builder\tacticOptimizer.cpp (1820) - TRTInternal Error in nvinfer1::builder::`anonymous-namespace'::LeafCNode::computeCosts: 0 (Could not find any implementation for node (Unnamed Layer* 176) [PluginV2DynamicExt].)
ERROR: C:\source\builder\tacticOptimizer.cpp (1820) - TRTInternal Error in nvinfer1::builder::`anonymous-namespace'::LeafCNode::computeCosts: 0 (Could not find any implementation for node (Unnamed Layer* 176) [PluginV2DynamicExt].)

It seem got cuda errors of the plugin layer.

My env:

Can you tell me how to solve this kind of problem or where it might go wrong？Thanks.

chrisHuxi commented 3 years ago

how did you generate the engine? by using trtexec or by code? if with trtexec, you can set more memory workspace by add a parameter "--workspace=3000" if with code, you can add "builder->setMaxBatchSize(1<<30);" when you build the network.

zengjie617789 commented 2 years ago

you shoul the related code in TensorRT/parsers/onnx to register the plugin