Open thalapandi opened 1 month ago
/usr/src/tensorrt/bin/trtexec --onnx=samples/models/Primary_Detector/yolov7-tiny41-nms-trt.onnx --saveEngine=samples/engines/Primary_Detector/yolov7-tiny41-nms-trt.trt --workspace=14336 --fp16 --minShapes=images:1x3x640x640 --optShapes=images:1x3x640x640 --maxShapes=images:4x3x640x640 --shapes=images:1x3x640x640 Then I get:
[02/06/2024-03:43:34] [W] [TRT] onnx2trt_utils.cpp:374: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32. [02/06/2024-03:43:34] [I] [TRT] No importer registered for op: EfficientNMSLandmark_TRT. Attempting to import as plugin. [02/06/2024-03:43:34] [I] [TRT] Searching for plugin: EfficientNMSLandmark_TRT, plugin_version: 1, plugin_namespace: [02/06/2024-03:43:34] [E] [TRT] 3: getPluginCreator could not find plugin: EfficientNMSLandmark_TRT version: 1 [02/06/2024-03:43:34] [E] [TRT] ModelImporter.cpp:771: While parsing node number 195 [EfficientNMSLandmark_TRT -> "num_dets"]: [02/06/2024-03:43:34] [E] [TRT] ModelImporter.cpp:772: --- Begin node --- [02/06/2024-03:43:34] [E] [TRT] ModelImporter.cpp:773: input: "441" input: "457" input: "456" output: "num_dets" output: "det_boxes" output: "det_scores" output: "det_classes" output: "det_lmks" name: "EfficientNMSLandmark_TRT_294" op_type: "EfficientNMSLandmark_TRT" attribute { name: "background_class" ints: -1 type: INTS } attribute { name: "box_coding" ints: 1 type: INTS } attribute { name: "iou_threshold" f: 0.5 type: FLOAT } attribute { name: "max_output_boxes" i: 100 type: INT } attribute { name: "plugin_version" s: "1" type: STRING } attribute { name: "score_activation" i: 0 type: INT } attribute { name: "score_threshold" f: 0.2 type: FLOAT }
[02/06/2024-03:43:34] [E] [TRT] ModelImporter.cpp:774: --- End node --- [02/06/2024-03:43:34] [E] [TRT] ModelImporter.cpp:777: ERROR: builtin_op_importers.cpp:5404 In function importFallbackPluginImporter: [8] Assertion failed: creator && "Plugin not found, are the plugin name, version, and namespace correct?" [02/06/2024-03:43:34] [E] Failed to parse onnx file [02/06/2024-03:43:34] [I] Finished parsing network model. Parse time: 0.143645 [02/06/2024-03:43:34] [E] Parsing model failed [02/06/2024-03:43:34] [E] Failed to create engine from model or file. [02/06/2024-03:43:34] [E] Engine set up failed &&&& FAILED TensorRT.trtexec [TensorRT v8601] # /usr/src/tensorrt/bin/trtexec --onnx=samples/models/Primary_Detector/yolov7-tiny41-nms-trt.onnx --saveEngine=samples/engines/Primary_Detector/yolov7-tiny41-nms-trt.trt --workspace=14336 --fp16 --minShapes=images:1x3x640x640 --optShapes=images:1x3x640x640 --maxShapes=images:4x3x640x640 --shapes=images:1x3x640x640
What was going wrong?
getting same error for me so how to resolve the issue jetson agx orin arm64 architecure with tensorrt 8.6.2 ?
can you help me to resolve the problem?
/usr/src/tensorrt/bin/trtexec --onnx=samples/models/Primary_Detector/yolov7-tiny41-nms-trt.onnx --saveEngine=samples/engines/Primary_Detector/yolov7-tiny41-nms-trt.trt --workspace=14336 --fp16 --minShapes=images:1x3x640x640 --optShapes=images:1x3x640x640 --maxShapes=images:4x3x640x640 --shapes=images:1x3x640x640 Then I get:
[02/06/2024-03:43:34] [W] [TRT] onnx2trt_utils.cpp:374: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32. [02/06/2024-03:43:34] [I] [TRT] No importer registered for op: EfficientNMSLandmark_TRT. Attempting to import as plugin. [02/06/2024-03:43:34] [I] [TRT] Searching for plugin: EfficientNMSLandmark_TRT, plugin_version: 1, plugin_namespace: [02/06/2024-03:43:34] [E] [TRT] 3: getPluginCreator could not find plugin: EfficientNMSLandmark_TRT version: 1 [02/06/2024-03:43:34] [E] [TRT] ModelImporter.cpp:771: While parsing node number 195 [EfficientNMSLandmark_TRT -> "num_dets"]: [02/06/2024-03:43:34] [E] [TRT] ModelImporter.cpp:772: --- Begin node --- [02/06/2024-03:43:34] [E] [TRT] ModelImporter.cpp:773: input: "441" input: "457" input: "456" output: "num_dets" output: "det_boxes" output: "det_scores" output: "det_classes" output: "det_lmks" name: "EfficientNMSLandmark_TRT_294" op_type: "EfficientNMSLandmark_TRT" attribute { name: "background_class" ints: -1 type: INTS } attribute { name: "box_coding" ints: 1 type: INTS } attribute { name: "iou_threshold" f: 0.5 type: FLOAT } attribute { name: "max_output_boxes" i: 100 type: INT } attribute { name: "plugin_version" s: "1" type: STRING } attribute { name: "score_activation" i: 0 type: INT } attribute { name: "score_threshold" f: 0.2 type: FLOAT }
[02/06/2024-03:43:34] [E] [TRT] ModelImporter.cpp:774: --- End node --- [02/06/2024-03:43:34] [E] [TRT] ModelImporter.cpp:777: ERROR: builtin_op_importers.cpp:5404 In function importFallbackPluginImporter: [8] Assertion failed: creator && "Plugin not found, are the plugin name, version, and namespace correct?" [02/06/2024-03:43:34] [E] Failed to parse onnx file [02/06/2024-03:43:34] [I] Finished parsing network model. Parse time: 0.143645 [02/06/2024-03:43:34] [E] Parsing model failed [02/06/2024-03:43:34] [E] Failed to create engine from model or file. [02/06/2024-03:43:34] [E] Engine set up failed &&&& FAILED TensorRT.trtexec [TensorRT v8601] # /usr/src/tensorrt/bin/trtexec --onnx=samples/models/Primary_Detector/yolov7-tiny41-nms-trt.onnx --saveEngine=samples/engines/Primary_Detector/yolov7-tiny41-nms-trt.trt --workspace=14336 --fp16 --minShapes=images:1x3x640x640 --optShapes=images:1x3x640x640 --maxShapes=images:4x3x640x640 --shapes=images:1x3x640x640
What was going wrong?
getting same error for me so how to resolve the issue jetson agx orin arm64 architecure with tensorrt 8.6.2 ?
can you help me to resolve the problem?