search

OAID / Tengine

Tengine is a lite, high performance, modular inference engine for embedded device
Apache License 2.0
4.66k stars 997 forks source link

yolov5s on TensorRT failed #1235

Open wfeii1980 opened 2 years ago

wfeii1980 commented 2 years ago

env

2021-12-20 16-01-16屏幕截图

error

CPU is OK CUDA GPU Low utilization TensorRT failed

$ tm_yolov5s -m yolov5s.tmfile -i images/ssd_dog.jpg
tengine-lite library version: 1.5-dev
Tengine Error: 4: [network.cpp::validate::2437] Error Code 4: Internal Error (Repeated tensor name: 203 (tensors must have distinct names))
Tengine: Can not Build engine, please check config.
Tengine Fatal: Pre-run subgraph(20) on TensorRT failed.
Tengine: Scheduler(sync) prerun failed.
Prerun multithread graph failed.
wfeii1980 commented 2 years ago 
$ /usr/src/tensorrt/bin/trtexec --onnx=model_opt.onnx --verbose
&&&& RUNNING TensorRT.trtexec [TensorRT v8001] # /usr/src/tensorrt/bin/trtexec --onnx=model_opt.onnx --verbose
[12/21/2021-10:09:45] [I] === Model Options ===
[12/21/2021-10:09:45] [I] Format: ONNX
[12/21/2021-10:09:45] [I] Model: model_opt.onnx
[12/21/2021-10:09:45] [I] Output:
[12/21/2021-10:09:45] [I] === Build Options ===
[12/21/2021-10:09:45] [I] Max batch: explicit
[12/21/2021-10:09:45] [I] Workspace: 16 MiB
[12/21/2021-10:09:45] [I] minTiming: 1
[12/21/2021-10:09:45] [I] avgTiming: 8
[12/21/2021-10:09:45] [I] Precision: FP32
[12/21/2021-10:09:45] [I] Calibration: 
[12/21/2021-10:09:45] [I] Refit: Disabled
[12/21/2021-10:09:45] [I] Sparsity: Disabled
[12/21/2021-10:09:45] [I] Safe mode: Disabled
[12/21/2021-10:09:45] [I] Restricted mode: Disabled
[12/21/2021-10:09:45] [I] Save engine: 
[12/21/2021-10:09:45] [I] Load engine: 
[12/21/2021-10:09:45] [I] NVTX verbosity: 0
[12/21/2021-10:09:45] [I] Tactic sources: Using default tactic sources
[12/21/2021-10:09:45] [I] timingCacheMode: local
[12/21/2021-10:09:45] [I] timingCacheFile: 
[12/21/2021-10:09:45] [I] Input(s)s format: fp32:CHW
[12/21/2021-10:09:45] [I] Output(s)s format: fp32:CHW
[12/21/2021-10:09:45] [I] Input build shapes: model
[12/21/2021-10:09:45] [I] Input calibration shapes: model
[12/21/2021-10:09:45] [I] === System Options ===
[12/21/2021-10:09:45] [I] Device: 0
[12/21/2021-10:09:45] [I] DLACore: 
[12/21/2021-10:09:45] [I] Plugins:
[12/21/2021-10:09:45] [I] === Inference Options ===
[12/21/2021-10:09:45] [I] Batch: Explicit
[12/21/2021-10:09:45] [I] Input inference shapes: model
[12/21/2021-10:09:45] [I] Iterations: 10
[12/21/2021-10:09:45] [I] Duration: 3s (+ 200ms warm up)
[12/21/2021-10:09:45] [I] Sleep time: 0ms
[12/21/2021-10:09:45] [I] Streams: 1
[12/21/2021-10:09:45] [I] ExposeDMA: Disabled
[12/21/2021-10:09:45] [I] Data transfers: Enabled
[12/21/2021-10:09:45] [I] Spin-wait: Disabled
[12/21/2021-10:09:45] [I] Multithreading: Disabled
[12/21/2021-10:09:45] [I] CUDA Graph: Disabled
[12/21/2021-10:09:45] [I] Separate profiling: Disabled
[12/21/2021-10:09:45] [I] Time Deserialize: Disabled
[12/21/2021-10:09:45] [I] Time Refit: Disabled
[12/21/2021-10:09:45] [I] Skip inference: Disabled
[12/21/2021-10:09:45] [I] Inputs:
[12/21/2021-10:09:45] [I] === Reporting Options ===
[12/21/2021-10:09:45] [I] Verbose: Enabled
[12/21/2021-10:09:45] [I] Averages: 10 inferences
[12/21/2021-10:09:45] [I] Percentile: 99
[12/21/2021-10:09:45] [I] Dump refittable layers:Disabled
[12/21/2021-10:09:45] [I] Dump output: Disabled
[12/21/2021-10:09:45] [I] Profile: Disabled
[12/21/2021-10:09:45] [I] Export timing to JSON file: 
[12/21/2021-10:09:45] [I] Export output to JSON file: 
[12/21/2021-10:09:45] [I] Export profile to JSON file: 
[12/21/2021-10:09:45] [I] 
[12/21/2021-10:09:45] [I] === Device Information ===
[12/21/2021-10:09:45] [I] Selected Device: Xavier
[12/21/2021-10:09:45] [I] Compute Capability: 7.2
[12/21/2021-10:09:45] [I] SMs: 6
[12/21/2021-10:09:45] [I] Compute Clock Rate: 1.109 GHz
[12/21/2021-10:09:45] [I] Device Global Memory: 7773 MiB
[12/21/2021-10:09:45] [I] Shared Memory per SM: 96 KiB
[12/21/2021-10:09:45] [I] Memory Bus Width: 256 bits (ECC disabled)
[12/21/2021-10:09:45] [I] Memory Clock Rate: 1.109 GHz
[12/21/2021-10:09:45] [I] 
[12/21/2021-10:09:45] [I] TensorRT version: 8001
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::GridAnchorRect_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::Region_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::ScatterND version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::BatchedNMSDynamic_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::CropAndResize version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::EfficientNMS_ONNX_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::EfficientNMS_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::Proposal version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::Split version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1
[12/21/2021-10:09:45] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1
[12/21/2021-10:09:47] [I] [TRT] [MemUsageChange] Init CUDA: CPU +353, GPU +0, now: CPU 371, GPU 4842 (MiB)
[12/21/2021-10:09:47] [I] Start parsing network model
[12/21/2021-10:09:47] [I] [TRT] ----------------------------------------------------------------
[12/21/2021-10:09:47] [I] [TRT] Input filename:   model_opt.onnx
[12/21/2021-10:09:47] [I] [TRT] ONNX IR version:  0.0.6
[12/21/2021-10:09:47] [I] [TRT] Opset version:    12
[12/21/2021-10:09:47] [I] [TRT] Producer name:    pytorch
[12/21/2021-10:09:47] [I] [TRT] Producer version: 1.8
[12/21/2021-10:09:47] [I] [TRT] Domain:           
[12/21/2021-10:09:47] [I] [TRT] Model version:    0
[12/21/2021-10:09:47] [I] [TRT] Doc string:       
[12/21/2021-10:09:47] [I] [TRT] ----------------------------------------------------------------
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::GridAnchorRect_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::Clip_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::ScatterND version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::BatchedNMSDynamic_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::EfficientNMS_ONNX_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::EfficientNMS_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::Proposal version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::Split version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1
[12/21/2021-10:09:47] [V] [TRT] Adding network input: 403 with dtype: float32, dimensions: (1, 12, 640, 640)
[12/21/2021-10:09:47] [V] [TRT] Registering tensor: 403 for ONNX tensor: 403
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: model.24.m.0.weight
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: model.24.m.0.bias
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: model.24.m.1.weight
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: model.24.m.1.bias
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: model.24.m.2.weight
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: model.24.m.2.bias
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 734
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 735
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 737
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 738
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 740
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 741
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 743
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 744
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 746
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 747
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 749
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 750
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 752
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 753
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 755
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 756
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 758
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 759
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 761
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 762
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 764
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 765
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 767
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 768
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 770
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 771
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 773
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 774
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 776
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 777
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 779
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 780
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 782
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 783
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 785
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 786
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 788
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 789
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 791
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 792
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 794
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 795
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 797
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 798
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 800
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 801
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 803
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 804
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 806
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 807
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 809
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 810
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 812
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 813
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 815
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 816
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 818
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 819
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 821
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 822
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 824
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 825
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 827
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 828
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 830
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 831
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 833
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 834
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 836
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 837
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 839
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 840
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 842
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 843
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 845
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 846
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 848
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 849
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 851
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 852
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 854
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 855
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 857
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 858
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 860
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 861
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 863
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 864
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 866
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 867
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 869
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 870
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 872
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 873
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 875
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 876
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 878
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 879
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 881
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 882
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 884
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 885
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 887
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 888
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 890
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 891
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 893
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 894
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 896
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 897
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 899
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 900
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 902
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 903
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 905
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 906
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 908
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 909
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 910
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 912
[12/21/2021-10:09:47] [W] [TRT] onnx2trt_utils.cpp:364: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 363
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 364
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 365
[12/21/2021-10:09:47] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647
[12/21/2021-10:09:47] [W] [TRT] onnx2trt_utils.cpp:390: One or more weights outside the range of INT32 was clamped
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 374
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 566
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 690
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 710
[12/21/2021-10:09:47] [V] [TRT] Importing initializer: 730
[12/21/2021-10:09:47] [V] [TRT] Parsing node: Conv_41 [Conv]
[12/21/2021-10:09:47] [V] [TRT] Searching for input: 403
[12/21/2021-10:09:47] [V] [TRT] Searching for input: 734
[12/21/2021-10:09:47] [V] [TRT] Searching for input: 735
[12/21/2021-10:09:47] [V] [TRT] Conv_41 [Conv] inputs: [403 -> (1, 12, 640, 640)[FLOAT]], [734 -> (32, 12, 3, 3)[FLOAT]], [735 -> (32)[FLOAT]], 
[12/21/2021-10:09:47] [V] [TRT] Convolution input dimensions: (1, 12, 640, 640)
[12/21/2021-10:09:47] [V] [TRT] Registering layer: Conv_41 for ONNX node: Conv_41
[12/21/2021-10:09:47] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 32
[12/21/2021-10:09:47] [V] [TRT] Convolution output dimensions: (1, 32, 640, 640)
[12/21/2021-10:09:47] [V] [TRT] Registering tensor: 733 for ONNX tensor: 733
[12/21/2021-10:09:47] [V] [TRT] Conv_41 [Conv] outputs: [733 -> (1, 32, 640, 640)[FLOAT]], 
[12/21/2021-10:09:47] [V] [TRT] Parsing node: Sigmoid_42 [HardSwish]
[12/21/2021-10:09:47] [V] [TRT] Searching for input: 733
[12/21/2021-10:09:47] [V] [TRT] Sigmoid_42 [HardSwish] inputs: [733 -> (1, 32, 640, 640)[FLOAT]], 
[12/21/2021-10:09:47] [I] [TRT] No importer registered for op: HardSwish. Attempting to import as plugin.
[12/21/2021-10:09:47] [I] [TRT] Searching for plugin: HardSwish, plugin_version: 1, plugin_namespace: 
[12/21/2021-10:09:47] [E] [TRT] 3: getPluginCreator could not find plugin: HardSwish version: 1
[12/21/2021-10:09:47] [E] [TRT] ModelImporter.cpp:720: While parsing node number 1 [HardSwish -> "407"]:
[12/21/2021-10:09:47] [E] [TRT] ModelImporter.cpp:721: --- Begin node ---
[12/21/2021-10:09:47] [E] [TRT] ModelImporter.cpp:722: input: "733"
output: "407"
name: "Sigmoid_42"
op_type: "HardSwish"

[12/21/2021-10:09:47] [E] [TRT] ModelImporter.cpp:723: --- End node ---
[12/21/2021-10:09:47] [E] [TRT] ModelImporter.cpp:726: ERROR: builtin_op_importers.cpp:4643 In function importFallbackPluginImporter:
[8] Assertion failed: creator && "Plugin not found, are the plugin name, version, and namespace correct?"
[12/21/2021-10:09:47] [E] Failed to parse onnx file
[12/21/2021-10:09:47] [I] Finish parsing network model
[12/21/2021-10:09:47] [E] Parsing model failed
[12/21/2021-10:09:47] [E] Engine creation failed
[12/21/2021-10:09:47] [E] Engine set up failed
&&&& FAILED TensorRT.trtexec [TensorRT v8001] # /usr/src/tensorrt/bin/trtexec --onnx=model_opt.onnx --verbose
wfeii1980 commented 2 years ago 
diff --git a/source/device/tensorrt/trt_limit.hpp b/source/device/tensorrt/trt_limit.hpp
index 0a9402e7..396d2834 100644
--- a/source/device/tensorrt/trt_limit.hpp
+++ b/source/device/tensorrt/trt_limit.hpp
@@ -88,7 +88,7 @@ const int trt_supported_ops[] = {
 //        OP_GRU,
 #endif
     //        OP_HARDSIGMOID,
-    //        OP_HARDSWISH,                   // Not supported, last checked version 7.1.3
+    OP_HARDSWISH,                   // Not supported, last checked version 7.1.3
     OP_INPUT,
     OP_INSTANCENORM,
     OP_INTERP, // should be as UpSample
ringwraith commented 2 years ago 
diff --git a/source/device/tensorrt/trt_limit.hpp b/source/device/tensorrt/trt_limit.hpp
index 0a9402e7..396d2834 100644
--- a/source/device/tensorrt/trt_limit.hpp
+++ b/source/device/tensorrt/trt_limit.hpp
@@ -88,7 +88,7 @@ const int trt_supported_ops[] = {
 //        OP_GRU,
 #endif
     //        OP_HARDSIGMOID,
-    //        OP_HARDSWISH,                   // Not supported, last checked version 7.1.3
+    OP_HARDSWISH,                   // Not supported, last checked version 7.1.3
     OP_INPUT,
     OP_INSTANCENORM,
     OP_INTERP, // should be as UpSample

Thanks for the solution!