failed to create NvDsinferContext instance, NvDsinfer Error: NVDSINFER_CONFIG_FAILED

[faizan1234567]

• Jetson Orin Nano DeveloperKit • Deep Stream: 6.4.0 • JetPack Version: 6.0-b52 • TensorRT Version: 8.6.2.3-1+cuda12.2 • CUDA: 12.2

I am trying to run YOLOV7 on Jetson Orin Nano. I have converted the yolov7_training.pt file into onnx format. Then I updated the “config_infer_primary_yoloV7.txt” with following settings:

[property] gpu-id=0 net-scale-factor=0.0039215697906911373 model-color-format=0 onnx-file=yolov7.onnx model-engine-file=model_b1_gpu0_fp32.engine

int8-calib-file=calib.table

labelfile-path=labels.txt batch-size=1 network-mode=0 num-detected-classes=80 interval=0 gie-unique-id=1 process-mode=1 network-type=0 cluster-mode=2 maintain-aspect-ratio=1 symmetric-padding=1

workspace-size=2000

parse-bbox-func-name=NvDsInferParseYolo

parse-bbox-func-name=NvDsInferParseYoloCuda

custom-lib-path=nvdsinfer_custom_impl_Yolo/libnvdsinfer_custom_impl_Yolo.so engine-create-func-name=NvDsInferYoloCudaEngineGet

[class-attrs-all] nms-iou-threshold=0.45 pre-cluster-threshold=0.25 topk=300

then I upated the ‘deepstream_app_config.txt’ with the following settings:

[application] enable-perf-measurement=1 perf-measurement-interval-sec=5

[tiled-display] enable=1 rows=1 columns=1 width=1280 height=720 gpu-id=0 nvbuf-memory-type=0

[source0] enable=1 type=3 uri=file:///opt/nvidia/deepstream/deepstream/samples/streams/sample_1080p_h264.mp4 num-sources=1 gpu-id=0 cudadec-memtype=0

[sink0] enable=1 type=2 sync=0 gpu-id=0 nvbuf-memory-type=0

[osd] enable=1 gpu-id=0 border-width=5 text-size=15 text-color=1;1;1;1; text-bg-color=0.3;0.3;0.3;1 font=Serif show-clock=0 clock-x-offset=800 clock-y-offset=820 clock-text-size=12 clock-color=1;0;0;0 nvbuf-memory-type=0

[streammux] gpu-id=0 live-source=0 batch-size=1 batched-push-timeout=40000 width=1920 height=1080 enable-padding=0 nvbuf-memory-type=0

[primary-gie] enable=1 gpu-id=0 gie-unique-id=2 operate-on-gie-id=1 operate-on-class-ids=0 nvbuf-memory-type=0 config-file=config_infer_primary_yoloV7.txt [tests] file-loop=0

when i run it using deepstream-app -c deepstream_app_config.txt, it gives me the following error: ailed to build CUDA engine ERROR: Failed to create network using custom network creation function ERROR: Failed to get cuda engine from custom library API 0:08:20.237117120 22787 0xaaaaed823e70 ERROR nvinfer gstnvinfer.cpp:676:gst_nvinfer_logger: NvDsInferContext[UID 2]: Error in NvDsInferContextImpl::buildModel() [UID = 2]: build engine file failed 0:08:20.661601186 22787 0xaaaaed823e70 ERROR nvinfer gstnvinfer.cpp:676:gst_nvinfer_logger: NvDsInferContext[UID 2]: Error in NvDsInferContextImpl::generateBackendContext() [UID = 2]: build backend context failed 0:08:20.661676165 22787 0xaaaaed823e70 ERROR nvinfer gstnvinfer.cpp:676:gst_nvinfer_logger: NvDsInferContext[UID 2]: Error in NvDsInferContextImpl::initialize() [UID = 2]: generate backend failed, check config file settings 0:08:20.662771448 22787 0xaaaaed823e70 WARN nvinfer gstnvinfer.cpp:898:gst_nvinfer_start: error: Failed to create NvDsInferContext instance 0:08:20.662810490 22787 0xaaaaed823e70 WARN nvinfer gstnvinfer.cpp:898:gst_nvinfer_start: error: Config file path: /home/jetson/faizan/yolos/DeepStream-Yolo/config_infer_primary_yoloV7.txt, NvDsInfer Error: NVDSINFER_CONFIG_FAILED ** ERROR: main:716: Failed to set pipeline to PAUSED Quitting nvstreammux: Successfully handled EOS for source_id=0 ERROR from primary_gie: Failed to create NvDsInferContext instance Debug info: /dvs/git/dirty/git-master_linux/deepstream/sdk/src/gst-plugins/gst-nvinfer/gstnvinfer.cpp(898): gst_nvinfer_start (): /GstPipeline:pipeline/GstBin:primary_gie_bin/GstNvInfer:primary_gie: Config file path: /home/jetson/faizan/yolos/DeepStream-Yolo/config_infer_primary_yoloV7.txt, NvDsInfer Error: NVDSINFER_CONFIG_FAILED App run failed

could you suggest what is the problem. I am exactly following the instructions but still getting the error.

[LatifahSul]

me either with yolov8

[marcoslucianops]

Please send the full output log.

[Fatima-Gh]

Same with RT-DETR DeepStream: 6.3 Cuda: 12.1