marcoslucianops / DeepStream-Yolo

NVIDIA DeepStream SDK 7.0 / 6.4 / 6.3 / 6.2 / 6.1.1 / 6.1 / 6.0.1 / 6.0 / 5.1 implementation for YOLO models
MIT License
1.39k stars 344 forks source link

segementation fault with yolox #432

Closed LrWm3 closed 10 months ago

LrWm3 commented 10 months ago

Working in deepstream docker. Tried both 6.2 and 6.3 docker images.

Using yolox_s.pth to generate the onnx file after following the instructions in the repository. (history below)

one thing stood out to me:

```INFO: ../nvdsinfer/nvdsinfer_model_builder.cpp:610 [Implicit Engine Info]: layers num: 2
0   INPUT  kFLOAT images          3x640x640       
1   OUTPUT kFLOAT output          8400x7          

But it looks like the parser is expecting there to be three outputs (in nvdsparsebbox_Yolo.cpp#L165-L169 )

I am not sure if this is an issue or if there is something I need to do to make it match the output here.

Output ‘boxes’ shape: [1, 8400, 4]
Output ‘scores’ shape: [1, 8400, 1]
Output ‘classes’ shape: [1, 8400, 1]

I can run the pipeline without issue if I use one of the models included in the DeepStream Samples folder, but so far have not been able to get a yolox model working.

Appreciate any guidance.

related command history

git clone https://github.com/Megvii-BaseDetection/YOLOX.git
cd YOLOX
pip3 install -r requirements.txt
python3 setup.py develop
pip3 install onnx onnxsim onnxruntime
cp ../DeepStream-Yolo/utils/export_yolox.py .
wget https://github.com/Megvii-BaseDetection/YOLOX/releases/download/0.1.1rc0/yolox_s.pth
python3 export_yolox.py -w yolox_s.pth -c exps/default/yolox_s.py --dynamic
cd ../DeepStream-Yolo
CUDA_VER=12.1 make -C nvdsinfer_custom_impl_Yolo

ys.txt

[property]
gpu-id=0
net-scale-factor=1
model-color-format=0
onnx-file=yolo_s.onnx
model-engine-file=model_b1_gpu0_fp32.engine
#int8-calib-file=calib.table
labelfile-path=labels.txt
batch-size=1
network-mode=0
num-detected-classes=2
interval=0
gie-unique-id=1
process-mode=1
network-type=0
cluster-mode=2
maintain-aspect-ratio=1
symmetric-padding=0
force-implicit-batch-dim=1
#workspace-size=1000
parse-bbox-func-name=NvDsInferParseYolo
#parse-bbox-func-name=NvDsInferParseYoloCuda
custom-lib-path=/opt/nvidia/deepstream/deepstream/DeepStream-Yolo/nvdsinfer_custom_impl_Yolo/libnvdsinfer_custom_impl_Yolo.so
engine-create-func-name=NvDsInferYoloCudaEngineGet

[class-attrs-all]
nms-iou-threshold=0.45
pre-cluster-threshold=0.25
topk=300

log of command itself

GST_DEBUG=4 gst-launch-1.0 filesrc location=samples/streams/sample_720p.mp4 ! qtdemux ! h264parse ! avdec_h264 ! nvvideoconvert ! mux.sink_0 nvstreammux live-source=0 name=mux batch-size=1 width=704 height=576 ! nvinfer config-file-path=/opt/nvidia/deepstream/deepstream/ys.txt ! fakesink
0:00:00.000104650  2962 0x55ee09a23800 INFO                GST_INIT gst.c:586:init_pre: Initializing GStreamer Core Library version 1.16.3
0:00:00.000159910  2962 0x55ee09a23800 INFO                GST_INIT gst.c:587:init_pre: Using library installed in /usr/lib/x86_64-linux-gnu
0:00:00.000174720  2962 0x55ee09a23800 INFO                GST_INIT gst.c:605:init_pre: Linux lambda-scalar 5.15.0-76-generic #83-Ubuntu SMP Thu Jun 15 19:16:32 UTC 2023 x86_64
0:00:00.000470400  2962 0x55ee09a23800 INFO                GST_INIT gstmessage.c:128:_priv_gst_message_initialize: init messages
0:00:00.000956991  2962 0x55ee09a23800 INFO                GST_INIT gstcontext.c:84:_priv_gst_context_initialize: init contexts
0:00:00.001150171  2962 0x55ee09a23800 INFO      GST_PLUGIN_LOADING gstplugin.c:318:_priv_gst_plugin_initialize: registering 0 static plugins
0:00:00.001209521  2962 0x55ee09a23800 INFO      GST_PLUGIN_LOADING gstplugin.c:226:gst_plugin_register_static: registered static plugin "staticelements"
0:00:00.001217351  2962 0x55ee09a23800 INFO      GST_PLUGIN_LOADING gstplugin.c:228:gst_plugin_register_static: added static plugin "staticelements", result: 1
0:00:00.001233881  2962 0x55ee09a23800 INFO            GST_REGISTRY gstregistry.c:1733:ensure_current_registry: reading registry cache: /root/.cache/gstreamer-1.0/registry.x86_64.bin
0:00:00.009699098  2962 0x55ee09a23800 INFO            GST_REGISTRY gstregistrybinary.c:621:priv_gst_registry_binary_read_cache: loaded /root/.cache/gstreamer-1.0/registry.x86_64.bin in 0.008444 seconds
0:00:00.009741708  2962 0x55ee09a23800 INFO            GST_REGISTRY gstregistry.c:1592:scan_and_update_registry: Validating plugins from registry cache: /root/.cache/gstreamer-1.0/registry.x86_64.bin
0:00:00.011161580  2962 0x55ee09a23800 INFO            GST_REGISTRY gstregistry.c:1691:scan_and_update_registry: Registry cache has not changed
0:00:00.011169420  2962 0x55ee09a23800 INFO            GST_REGISTRY gstregistry.c:1768:ensure_current_registry: registry reading and updating done, result = 1
0:00:00.011174649  2962 0x55ee09a23800 INFO                GST_INIT gst.c:806:init_post: GLib runtime version: 2.64.6
0:00:00.011178609  2962 0x55ee09a23800 INFO                GST_INIT gst.c:808:init_post: GLib headers version: 2.64.6
0:00:00.011181569  2962 0x55ee09a23800 INFO                GST_INIT gst.c:810:init_post: initialized GStreamer successfully
0:00:00.011198710  2962 0x55ee09a23800 INFO            GST_PIPELINE gstparse.c:336:gst_parse_launch_full: parsing pipeline description 'filesrc location=samples/streams/sample_720p.mp4 ! qtdemux ! h264parse ! avdec_h264 ! nvvideoconvert ! mux.sink_0 nvstreammux live-source=0 name=mux batch-size=1 width=704 height=576 ! nvinfer config-file-path=/opt/nvidia/deepstream/deepstream/ys.txt ! fakesink '
0:00:00.011609400  2962 0x55ee09a23800 INFO      GST_PLUGIN_LOADING gstplugin.c:902:_priv_gst_plugin_load_file_for_registry: plugin "/usr/lib/x86_64-linux-gnu/gstreamer-1.0/libgstcoreelements.so" loaded
0:00:00.011622360  2962 0x55ee09a23800 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:363:gst_element_factory_create: creating element "filesrc"
0:00:00.011675700  2962 0x55ee09a23800 INFO        GST_ELEMENT_PADS gstelement.c:671:gst_element_add_pad:<GstBaseSrc@0x55ee09c601c0> adding pad 'src'
0:00:00.011702210  2962 0x55ee09a23800 INFO                 filesrc gstfilesrc.c:261:gst_file_src_set_location: filename : samples/streams/sample_720p.mp4
0:00:00.011708080  2962 0x55ee09a23800 INFO                 filesrc gstfilesrc.c:262:gst_file_src_set_location: uri      : file:///opt/nvidia/deepstream/deepstream/samples/streams/sample_720p.mp4
0:00:00.012839721  2962 0x55ee09a23800 INFO      GST_PLUGIN_LOADING gstplugin.c:902:_priv_gst_plugin_load_file_for_registry: plugin "/usr/lib/x86_64-linux-gnu/gstreamer-1.0/libgstisomp4.so" loaded
0:00:00.012859121  2962 0x55ee09a23800 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:363:gst_element_factory_create: creating element "qtdemux"
0:00:00.012920381  2962 0x55ee09a23800 INFO        GST_ELEMENT_PADS gstelement.c:671:gst_element_add_pad:<GstQTDemux@0x55ee09c761b0> adding pad 'sink'
0:00:00.013179951  2962 0x55ee09a23800 INFO      GST_PLUGIN_LOADING gstplugin.c:902:_priv_gst_plugin_load_file_for_registry: plugin "/usr/lib/x86_64-linux-gnu/gstreamer-1.0/libgstvideoparsersbad.so" loaded
0:00:00.013191431  2962 0x55ee09a23800 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:363:gst_element_factory_create: creating element "h264parse"
0:00:00.013233451  2962 0x55ee09a23800 INFO        GST_ELEMENT_PADS gstelement.c:671:gst_element_add_pad:<GstBaseParse@0x55ee09c7ca60> adding pad 'sink'
0:00:00.013244621  2962 0x55ee09a23800 INFO        GST_ELEMENT_PADS gstelement.c:671:gst_element_add_pad:<GstBaseParse@0x55ee09c7ca60> adding pad 'src'
0:00:00.013261661  2962 0x55ee09a23800 INFO               baseparse gstbaseparse.c:4026:gst_base_parse_set_pts_interpolation:<GstH264Parse@0x55ee09c7ca60> PTS interpolation: no
0:00:00.047713971  2962 0x55ee09a23800 INFO            GST_TYPEFIND gsttypefind.c:72:gst_type_find_register: registering typefind function for avtype_avs
0:00:00.047805231  2962 0x55ee09a23800 INFO            GST_TYPEFIND gsttypefind.c:72:gst_type_find_register: registering typefind function for avtype_bfstm
0:00:00.047824941  2962 0x55ee09a23800 INFO            GST_TYPEFIND gsttypefind.c:72:gst_type_find_register: registering typefind function for avtype_brstm
0:00:00.047847851  2962 0x55ee09a23800 INFO            GST_TYPEFIND gsttypefind.c:72:gst_type_find_register: registering typefind function for avtype_daud
0:00:00.047864221  2962 0x55ee09a23800 INFO            GST_TYPEFIND gsttypefind.c:72:gst_type_find_register: registering typefind function for avtype_dsf
0:00:00.047882961  2962 0x55ee09a23800 INFO            GST_TYPEFIND gsttypefind.c:72:gst_type_find_register: registering typefind function for avtype_ea
0:00:00.047903891  2962 0x55ee09a23800 INFO            GST_TYPEFIND gsttypefind.c:72:gst_type_find_register: registering typefind function for avtype_4xm
0:00:00.047924861  2962 0x55ee09a23800 INFO            GST_TYPEFIND gsttypefind.c:72:gst_type_find_register: registering typefind function for avtype_gxf
0:00:00.047952431  2962 0x55ee09a23800 INFO            GST_TYPEFIND gsttypefind.c:72:gst_type_find_register: registering typefind function for avtype_idcin
0:00:00.047967461  2962 0x55ee09a23800 INFO            GST_TYPEFIND gsttypefind.c:72:gst_type_find_register: registering typefind function for avtype_iff
0:00:00.047984201  2962 0x55ee09a23800 INFO            GST_TYPEFIND gsttypefind.c:72:gst_type_find_register: registering typefind function for avtype_ipmovie
0:00:00.048013221  2962 0x55ee09a23800 INFO            GST_TYPEFIND gsttypefind.c:72:gst_type_find_register: registering typefind function for avtype_mm
0:00:00.048026261  2962 0x55ee09a23800 INFO            GST_TYPEFIND gsttypefind.c:72:gst_type_find_register: registering typefind function for avtype_mmf
0:00:00.048057931  2962 0x55ee09a23800 INFO            GST_TYPEFIND gsttypefind.c:72:gst_type_find_register: registering typefind function for avtype_nsv
0:00:00.048071791  2962 0x55ee09a23800 INFO            GST_TYPEFIND gsttypefind.c:72:gst_type_find_register: registering typefind function for avtype_nut
0:00:00.048115641  2962 0x55ee09a23800 INFO            GST_TYPEFIND gsttypefind.c:72:gst_type_find_register: registering typefind function for avtype_film_cpk
0:00:00.048131941  2962 0x55ee09a23800 INFO            GST_TYPEFIND gsttypefind.c:72:gst_type_find_register: registering typefind function for avtype_smk
0:00:00.048145821  2962 0x55ee09a23800 INFO            GST_TYPEFIND gsttypefind.c:72:gst_type_find_register: registering typefind function for avtype_sol
0:00:00.048161051  2962 0x55ee09a23800 INFO            GST_TYPEFIND gsttypefind.c:72:gst_type_find_register: registering typefind function for avtype_psxstr
0:00:00.048188561  2962 0x55ee09a23800 INFO            GST_TYPEFIND gsttypefind.c:72:gst_type_find_register: registering typefind function for avtype_vmd
0:00:00.048207601  2962 0x55ee09a23800 INFO            GST_TYPEFIND gsttypefind.c:72:gst_type_find_register: registering typefind function for avtype_wc3movie
0:00:00.048222981  2962 0x55ee09a23800 INFO            GST_TYPEFIND gsttypefind.c:72:gst_type_find_register: registering typefind function for avtype_wsaud
0:00:00.048236611  2962 0x55ee09a23800 INFO            GST_TYPEFIND gsttypefind.c:72:gst_type_find_register: registering typefind function for avtype_wsvqa
0:00:00.048256181  2962 0x55ee09a23800 INFO            GST_TYPEFIND gsttypefind.c:72:gst_type_find_register: registering typefind function for avtype_yuv4mpegpipe
0:00:00.048448871  2962 0x55ee09a23800 INFO      GST_PLUGIN_LOADING gstplugin.c:902:_priv_gst_plugin_load_file_for_registry: plugin "/usr/lib/x86_64-linux-gnu/gstreamer-1.0/libgstlibav.so" loaded
0:00:00.048454611  2962 0x55ee09a23800 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:363:gst_element_factory_create: creating element "avdec_h264"
0:00:00.048537212  2962 0x55ee09a23800 INFO        GST_ELEMENT_PADS gstelement.c:671:gst_element_add_pad:<GstVideoDecoder@0x55ee09d27b40> adding pad 'sink'
0:00:00.048546021  2962 0x55ee09a23800 INFO        GST_ELEMENT_PADS gstelement.c:671:gst_element_add_pad:<GstVideoDecoder@0x55ee09d27b40> adding pad 'src'
0:00:00.435607733  2962 0x55ee09a23800 INFO      GST_PLUGIN_LOADING gstplugin.c:902:_priv_gst_plugin_load_file_for_registry: plugin "/usr/lib/x86_64-linux-gnu/gstreamer-1.0/deepstream/libgstnvvideoconvert.so" loaded
0:00:00.435635363  2962 0x55ee09a23800 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:363:gst_element_factory_create: creating element "nvvideoconvert"
0:00:00.435758213  2962 0x55ee09a23800 INFO        GST_ELEMENT_PADS gstelement.c:671:gst_element_add_pad:<GstBaseTransform@0x55ee0a2541e0> adding pad 'sink'
0:00:00.435768103  2962 0x55ee09a23800 INFO        GST_ELEMENT_PADS gstelement.c:671:gst_element_add_pad:<GstBaseTransform@0x55ee0a2541e0> adding pad 'src'
0:00:00.436913694  2962 0x55ee09a23800 INFO      GST_PLUGIN_LOADING gstplugin.c:902:_priv_gst_plugin_load_file_for_registry: plugin "/usr/lib/x86_64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_multistream.so" loaded
0:00:00.436924804  2962 0x55ee09a23800 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:363:gst_element_factory_create: creating element "nvstreammux"
0:00:00.436991944  2962 0x55ee09a23800 INFO        GST_ELEMENT_PADS gstelement.c:671:gst_element_add_pad:<GstNvStreamMux@0x55ee0ace80d0> adding pad 'src'
0:00:00.475901567  2962 0x55ee09a23800 INFO      GST_PLUGIN_LOADING gstplugin.c:902:_priv_gst_plugin_load_file_for_registry: plugin "/usr/lib/x86_64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_infer.so" loaded
0:00:00.475937787  2962 0x55ee09a23800 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:363:gst_element_factory_create: creating element "nvinfer"
0:00:00.476055467  2962 0x55ee09a23800 INFO        GST_ELEMENT_PADS gstelement.c:671:gst_element_add_pad:<GstBaseTransform@0x55ee0b6b7da0> adding pad 'sink'
0:00:00.476067227  2962 0x55ee09a23800 INFO        GST_ELEMENT_PADS gstelement.c:671:gst_element_add_pad:<GstBaseTransform@0x55ee0b6b7da0> adding pad 'src'
0:00:00.476420317  2962 0x55ee09a23800 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:363:gst_element_factory_create: creating element "fakesink"
0:00:00.476477578  2962 0x55ee09a23800 INFO        GST_ELEMENT_PADS gstelement.c:671:gst_element_add_pad:<GstBaseSink@0x55ee0b6a1fd0> adding pad 'sink'
0:00:00.476491327  2962 0x55ee09a23800 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:363:gst_element_factory_create: creating element "pipeline"
0:00:00.476586947  2962 0x55ee09a23800 INFO            GST_PIPELINE grammar.y:648:gst_parse_perform_link: linking some pad of GstFileSrc named filesrc0 to some pad of GstQTDemux named qtdemux0 (0/0) with caps "(NULL)"
0:00:00.476594598  2962 0x55ee09a23800 INFO        GST_ELEMENT_PADS gstutils.c:1771:gst_element_link_pads_full: trying to link element filesrc0:(any) to element qtdemux0:(any)
0:00:00.476600978  2962 0x55ee09a23800 INFO                GST_PADS gstutils.c:1034:gst_pad_check_link: trying to link filesrc0:src and qtdemux0:sink
0:00:00.476613118  2962 0x55ee09a23800 INFO                GST_PADS gstutils.c:1587:prepare_link_maybe_ghosting: filesrc0 and qtdemux0 in same bin, no need for ghost pads
0:00:00.476621367  2962 0x55ee09a23800 INFO                GST_PADS gstpad.c:2377:gst_pad_link_prepare: trying to link filesrc0:src and qtdemux0:sink
0:00:00.476628287  2962 0x55ee09a23800 INFO                GST_PADS gstpad.c:2585:gst_pad_link_full: linked filesrc0:src and qtdemux0:sink, successful
0:00:00.476632727  2962 0x55ee09a23800 INFO               GST_EVENT gstevent.c:1579:gst_event_new_reconfigure: creating reconfigure event
0:00:00.476638227  2962 0x55ee09a23800 INFO               GST_EVENT gstpad.c:5812:gst_pad_send_event_unchecked:<filesrc0:src> Received event on flushing pad. Discarding
0:00:00.476649067  2962 0x55ee09a23800 INFO            GST_PIPELINE grammar.y:648:gst_parse_perform_link: linking some pad of GstQTDemux named qtdemux0 to some pad of GstH264Parse named h264parse0 (0/0) with caps "(NULL)"
0:00:00.476659518  2962 0x55ee09a23800 INFO        GST_ELEMENT_PADS gstutils.c:1771:gst_element_link_pads_full: trying to link element qtdemux0:(any) to element h264parse0:(any)
0:00:00.476671218  2962 0x55ee09a23800 INFO                GST_PADS gstpad.c:4237:gst_pad_peer_query:<h264parse0:src> pad has no peer
0:00:00.476689358  2962 0x55ee09a23800 INFO        GST_ELEMENT_PADS gstelement.c:925:gst_element_get_static_pad: no such pad 'video_%u' in element "qtdemux0"
0:00:00.476697168  2962 0x55ee09a23800 INFO        GST_ELEMENT_PADS gstutils.c:1225:gst_element_get_compatible_pad:<qtdemux0> Could not find a compatible pad to link to h264parse0:sink
0:00:00.476701648  2962 0x55ee09a23800 INFO                 default gstutils.c:2161:gst_element_link_pads_filtered: Could not link pads: qtdemux0:(null) - h264parse0:(null)
0:00:00.476714278  2962 0x55ee09a23800 INFO            GST_PIPELINE grammar.y:648:gst_parse_perform_link: linking some pad of GstH264Parse named h264parse0 to some pad of avdec_h264 named avdec_h264-0 (0/0) with caps "(NULL)"
0:00:00.476720948  2962 0x55ee09a23800 INFO        GST_ELEMENT_PADS gstutils.c:1771:gst_element_link_pads_full: trying to link element h264parse0:(any) to element avdec_h264-0:(any)
0:00:00.476725488  2962 0x55ee09a23800 INFO                GST_PADS gstutils.c:1034:gst_pad_check_link: trying to link h264parse0:src and avdec_h264-0:sink
0:00:00.476733968  2962 0x55ee09a23800 INFO                GST_PADS gstpad.c:4237:gst_pad_peer_query:<avdec_h264-0:src> pad has no peer
0:00:00.476753918  2962 0x55ee09a23800 INFO                GST_PADS gstutils.c:1587:prepare_link_maybe_ghosting: h264parse0 and avdec_h264-0 in same bin, no need for ghost pads
0:00:00.476761548  2962 0x55ee09a23800 INFO                GST_PADS gstpad.c:2377:gst_pad_link_prepare: trying to link h264parse0:src and avdec_h264-0:sink
0:00:00.476767498  2962 0x55ee09a23800 INFO                GST_PADS gstpad.c:4237:gst_pad_peer_query:<avdec_h264-0:src> pad has no peer
0:00:00.476780188  2962 0x55ee09a23800 INFO                GST_PADS gstpad.c:2585:gst_pad_link_full: linked h264parse0:src and avdec_h264-0:sink, successful
0:00:00.476785088  2962 0x55ee09a23800 INFO               GST_EVENT gstevent.c:1579:gst_event_new_reconfigure: creating reconfigure event
0:00:00.476790268  2962 0x55ee09a23800 INFO               GST_EVENT gstpad.c:5812:gst_pad_send_event_unchecked:<h264parse0:src> Received event on flushing pad. Discarding
0:00:00.476801188  2962 0x55ee09a23800 INFO            GST_PIPELINE grammar.y:648:gst_parse_perform_link: linking some pad of avdec_h264 named avdec_h264-0 to some pad of Gstnvvideoconvert named nvvideoconvert0 (0/0) with caps "(NULL)"
0:00:00.476807098  2962 0x55ee09a23800 INFO        GST_ELEMENT_PADS gstutils.c:1771:gst_element_link_pads_full: trying to link element avdec_h264-0:(any) to element nvvideoconvert0:(any)
0:00:00.476812908  2962 0x55ee09a23800 INFO                GST_PADS gstutils.c:1034:gst_pad_check_link: trying to link avdec_h264-0:src and nvvideoconvert0:sink
0:00:00.476822728  2962 0x55ee09a23800 INFO                GST_PADS gstpad.c:4237:gst_pad_peer_query:<nvvideoconvert0:src> pad has no peer
0:00:00.476874008  2962 0x55ee09a23800 INFO                GST_PADS gstutils.c:1587:prepare_link_maybe_ghosting: avdec_h264-0 and nvvideoconvert0 in same bin, no need for ghost pads
0:00:00.476882108  2962 0x55ee09a23800 INFO                GST_PADS gstpad.c:2377:gst_pad_link_prepare: trying to link avdec_h264-0:src and nvvideoconvert0:sink
0:00:00.476889158  2962 0x55ee09a23800 INFO                GST_PADS gstpad.c:4237:gst_pad_peer_query:<nvvideoconvert0:src> pad has no peer
0:00:00.476912068  2962 0x55ee09a23800 INFO                GST_PADS gstpad.c:2585:gst_pad_link_full: linked avdec_h264-0:src and nvvideoconvert0:sink, successful
0:00:00.476919528  2962 0x55ee09a23800 INFO               GST_EVENT gstevent.c:1579:gst_event_new_reconfigure: creating reconfigure event
0:00:00.476922298  2962 0x55ee09a23800 INFO               GST_EVENT gstpad.c:5812:gst_pad_send_event_unchecked:<avdec_h264-0:src> Received event on flushing pad. Discarding
0:00:00.476931258  2962 0x55ee09a23800 INFO           GST_PARENTAGE gstbin.c:4478:gst_bin_get_by_name: [pipeline0]: looking up child element mux
0:00:00.476941448  2962 0x55ee09a23800 INFO            GST_PIPELINE grammar.y:648:gst_parse_perform_link: linking some pad of Gstnvvideoconvert named nvvideoconvert0 to pad  mux of GstNvStreamMux named mux (0/1) with caps "(NULL)"
0:00:00.476950548  2962 0x55ee09a23800 INFO        GST_ELEMENT_PADS gstutils.c:1771:gst_element_link_pads_full: trying to link element nvvideoconvert0:(any) to element mux:sink_0
0:00:00.476956728  2962 0x55ee09a23800 INFO        GST_ELEMENT_PADS gstelement.c:925:gst_element_get_static_pad: no such pad 'sink_0' in element "mux"
0:00:00.476962828  2962 0x55ee09a23800 INFO        GST_ELEMENT_PADS gstelement.c:925:gst_element_get_static_pad: no such pad 'sink_0' in element "mux"
0:00:00.476992318  2962 0x55ee09a23800 INFO        GST_ELEMENT_PADS gstelement.c:671:gst_element_add_pad:<mux> adding pad 'sink_0'
0:00:00.477001198  2962 0x55ee09a23800 INFO                GST_PADS gstutils.c:1587:prepare_link_maybe_ghosting: nvvideoconvert0 and mux in same bin, no need for ghost pads
0:00:00.477006118  2962 0x55ee09a23800 INFO                GST_PADS gstpad.c:2377:gst_pad_link_prepare: trying to link nvvideoconvert0:src and mux:sink_0
0:00:00.477078048  2962 0x55ee09a23800 INFO                GST_PADS gstpad.c:4237:gst_pad_peer_query:<mux:src> pad has no peer
0:00:00.477098748  2962 0x55ee09a23800 INFO                GST_PADS gstpad.c:2585:gst_pad_link_full: linked nvvideoconvert0:src and mux:sink_0, successful
0:00:00.477103118  2962 0x55ee09a23800 INFO               GST_EVENT gstevent.c:1579:gst_event_new_reconfigure: creating reconfigure event
0:00:00.477107258  2962 0x55ee09a23800 INFO               GST_EVENT gstpad.c:5812:gst_pad_send_event_unchecked:<nvvideoconvert0:src> Received event on flushing pad. Discarding
0:00:00.477118198  2962 0x55ee09a23800 INFO            GST_PIPELINE grammar.y:648:gst_parse_perform_link: linking some pad of GstNvStreamMux named mux to some pad of GstNvInfer named nvinfer0 (0/0) with caps "(NULL)"
0:00:00.477127178  2962 0x55ee09a23800 INFO        GST_ELEMENT_PADS gstutils.c:1771:gst_element_link_pads_full: trying to link element mux:(any) to element nvinfer0:(any)
0:00:00.477134598  2962 0x55ee09a23800 INFO                GST_PADS gstutils.c:1034:gst_pad_check_link: trying to link mux:src and nvinfer0:sink
0:00:00.477140678  2962 0x55ee09a23800 INFO                GST_PADS gstpad.c:4237:gst_pad_peer_query:<nvinfer0:src> pad has no peer
0:00:00.477152418  2962 0x55ee09a23800 INFO                GST_PADS gstutils.c:1587:prepare_link_maybe_ghosting: mux and nvinfer0 in same bin, no need for ghost pads
0:00:00.477162738  2962 0x55ee09a23800 INFO                GST_PADS gstpad.c:2377:gst_pad_link_prepare: trying to link mux:src and nvinfer0:sink
0:00:00.477172538  2962 0x55ee09a23800 INFO                GST_PADS gstpad.c:4237:gst_pad_peer_query:<nvinfer0:src> pad has no peer
0:00:00.477184588  2962 0x55ee09a23800 INFO                GST_PADS gstpad.c:2585:gst_pad_link_full: linked mux:src and nvinfer0:sink, successful
0:00:00.477189358  2962 0x55ee09a23800 INFO               GST_EVENT gstevent.c:1579:gst_event_new_reconfigure: creating reconfigure event
0:00:00.477194568  2962 0x55ee09a23800 INFO               GST_EVENT gstpad.c:5812:gst_pad_send_event_unchecked:<mux:src> Received event on flushing pad. Discarding
0:00:00.477202938  2962 0x55ee09a23800 INFO            GST_PIPELINE grammar.y:648:gst_parse_perform_link: linking some pad of GstNvInfer named nvinfer0 to some pad of GstFakeSink named fakesink0 (0/0) with caps "(NULL)"
0:00:00.477209518  2962 0x55ee09a23800 INFO        GST_ELEMENT_PADS gstutils.c:1771:gst_element_link_pads_full: trying to link element nvinfer0:(any) to element fakesink0:(any)
0:00:00.477223848  2962 0x55ee09a23800 INFO                GST_PADS gstutils.c:1034:gst_pad_check_link: trying to link nvinfer0:src and fakesink0:sink
0:00:00.477238388  2962 0x55ee09a23800 INFO                GST_PADS gstutils.c:1587:prepare_link_maybe_ghosting: nvinfer0 and fakesink0 in same bin, no need for ghost pads
0:00:00.477247048  2962 0x55ee09a23800 INFO                GST_PADS gstpad.c:2377:gst_pad_link_prepare: trying to link nvinfer0:src and fakesink0:sink
0:00:00.477260258  2962 0x55ee09a23800 INFO                GST_PADS gstpad.c:2585:gst_pad_link_full: linked nvinfer0:src and fakesink0:sink, successful
0:00:00.477265318  2962 0x55ee09a23800 INFO               GST_EVENT gstevent.c:1579:gst_event_new_reconfigure: creating reconfigure event
0:00:00.477268318  2962 0x55ee09a23800 INFO               GST_EVENT gstpad.c:5812:gst_pad_send_event_unchecked:<nvinfer0:src> Received event on flushing pad. Discarding
Setting pipeline to PAUSED ...
0:00:00.477310828  2962 0x55ee09a23800 INFO              GST_STATES gstbin.c:2503:gst_bin_element_set_state:<fakesink0> current NULL pending VOID_PENDING, desired next READY
0:00:00.477318958  2962 0x55ee09a23800 INFO              GST_STATES gstelement.c:2688:gst_element_continue_state:<fakesink0> completed state change to READY
0:00:00.477325608  2962 0x55ee09a23800 INFO              GST_STATES gstelement.c:2588:_priv_gst_element_state_changed:<fakesink0> notifying about state-changed NULL to READY (VOID_PENDING pending)
0:00:00.477355888  2962 0x55ee09a23800 INFO              GST_STATES gstbin.c:2952:gst_bin_change_state_func:<pipeline0> child 'fakesink0' changed state to 2(READY) successfully
0:00:00.477363908  2962 0x55ee09a23800 INFO              GST_STATES gstbin.c:2503:gst_bin_element_set_state:<nvinfer0> current NULL pending VOID_PENDING, desired next READY
0:00:00.477369088  2962 0x55ee09a23800 INFO              GST_STATES gstelement.c:2688:gst_element_continue_state:<nvinfer0> completed state change to READY
0:00:00.477374588  2962 0x55ee09a23800 INFO              GST_STATES gstelement.c:2588:_priv_gst_element_state_changed:<nvinfer0> notifying about state-changed NULL to READY (VOID_PENDING pending)
0:00:00.477380648  2962 0x55ee09a23800 INFO              GST_STATES gstbin.c:2952:gst_bin_change_state_func:<pipeline0> child 'nvinfer0' changed state to 2(READY) successfully
0:00:00.477388328  2962 0x55ee09a23800 INFO              GST_STATES gstbin.c:2503:gst_bin_element_set_state:<mux> current NULL pending VOID_PENDING, desired next READY
0:00:00.646569383  2962 0x55ee09a23800 INFO              GST_STATES gstelement.c:2688:gst_element_continue_state:<mux> completed state change to READY
0:00:00.646609383  2962 0x55ee09a23800 INFO              GST_STATES gstelement.c:2588:_priv_gst_element_state_changed:<mux> notifying about state-changed NULL to READY (VOID_PENDING pending)
0:00:00.646635663  2962 0x55ee09a23800 INFO              GST_STATES gstbin.c:2952:gst_bin_change_state_func:<pipeline0> child 'mux' changed state to 2(READY) successfully
0:00:00.646650613  2962 0x55ee09a23800 INFO              GST_STATES gstbin.c:2503:gst_bin_element_set_state:<nvvideoconvert0> current NULL pending VOID_PENDING, desired next READY
0:00:00.646658193  2962 0x55ee09a23800 INFO              GST_STATES gstelement.c:2688:gst_element_continue_state:<nvvideoconvert0> completed state change to READY
0:00:00.646662913  2962 0x55ee09a23800 INFO              GST_STATES gstelement.c:2588:_priv_gst_element_state_changed:<nvvideoconvert0> notifying about state-changed NULL to READY (VOID_PENDING pending)
0:00:00.646668953  2962 0x55ee09a23800 INFO              GST_STATES gstbin.c:2952:gst_bin_change_state_func:<pipeline0> child 'nvvideoconvert0' changed state to 2(READY) successfully
0:00:00.646675873  2962 0x55ee09a23800 INFO              GST_STATES gstbin.c:2503:gst_bin_element_set_state:<avdec_h264-0> current NULL pending VOID_PENDING, desired next READY
0:00:00.646681783  2962 0x55ee09a23800 INFO              GST_STATES gstelement.c:2688:gst_element_continue_state:<avdec_h264-0> completed state change to READY
0:00:00.646687793  2962 0x55ee09a23800 INFO              GST_STATES gstelement.c:2588:_priv_gst_element_state_changed:<avdec_h264-0> notifying about state-changed NULL to READY (VOID_PENDING pending)
0:00:00.646694513  2962 0x55ee09a23800 INFO              GST_STATES gstbin.c:2952:gst_bin_change_state_func:<pipeline0> child 'avdec_h264-0' changed state to 2(READY) successfully
0:00:00.646700983  2962 0x55ee09a23800 INFO              GST_STATES gstbin.c:2503:gst_bin_element_set_state:<h264parse0> current NULL pending VOID_PENDING, desired next READY
0:00:00.646707593  2962 0x55ee09a23800 INFO              GST_STATES gstelement.c:2688:gst_element_continue_state:<h264parse0> completed state change to READY
0:00:00.646712923  2962 0x55ee09a23800 INFO              GST_STATES gstelement.c:2588:_priv_gst_element_state_changed:<h264parse0> notifying about state-changed NULL to READY (VOID_PENDING pending)
0:00:00.646720563  2962 0x55ee09a23800 INFO              GST_STATES gstbin.c:2952:gst_bin_change_state_func:<pipeline0> child 'h264parse0' changed state to 2(READY) successfully
0:00:00.646728683  2962 0x55ee09a23800 INFO              GST_STATES gstbin.c:2503:gst_bin_element_set_state:<qtdemux0> current NULL pending VOID_PENDING, desired next READY
0:00:00.646735083  2962 0x55ee09a23800 INFO              GST_STATES gstelement.c:2688:gst_element_continue_state:<qtdemux0> completed state change to READY
0:00:00.646742393  2962 0x55ee09a23800 INFO              GST_STATES gstelement.c:2588:_priv_gst_element_state_changed:<qtdemux0> notifying about state-changed NULL to READY (VOID_PENDING pending)
0:00:00.646752473  2962 0x55ee09a23800 INFO              GST_STATES gstbin.c:2952:gst_bin_change_state_func:<pipeline0> child 'qtdemux0' changed state to 2(READY) successfully
0:00:00.646759883  2962 0x55ee09a23800 INFO              GST_STATES gstbin.c:2503:gst_bin_element_set_state:<filesrc0> current NULL pending VOID_PENDING, desired next READY
0:00:00.646764093  2962 0x55ee09a23800 INFO              GST_STATES gstelement.c:2688:gst_element_continue_state:<filesrc0> completed state change to READY
0:00:00.646768253  2962 0x55ee09a23800 INFO              GST_STATES gstelement.c:2588:_priv_gst_element_state_changed:<filesrc0> notifying about state-changed NULL to READY (VOID_PENDING pending)
0:00:00.646772983  2962 0x55ee09a23800 INFO              GST_STATES gstbin.c:2952:gst_bin_change_state_func:<pipeline0> child 'filesrc0' changed state to 2(READY) successfully
0:00:00.646782853  2962 0x55ee09a23800 INFO              GST_STATES gstelement.c:2660:gst_element_continue_state:<pipeline0> committing state from NULL to READY, pending PAUSED, next PAUSED
0:00:00.646787633  2962 0x55ee09a23800 INFO              GST_STATES gstelement.c:2588:_priv_gst_element_state_changed:<pipeline0> notifying about state-changed NULL to READY (PAUSED pending)
0:00:00.646832493  2962 0x55ee09a23800 INFO              GST_STATES gstelement.c:2668:gst_element_continue_state:<pipeline0> continue state change READY to PAUSED, final PAUSED
0:00:00.646848463  2962 0x55ee09a23800 INFO              GST_STATES gstbin.c:2503:gst_bin_element_set_state:<fakesink0> current READY pending VOID_PENDING, desired next PAUSED
0:00:00.646860443  2962 0x55ee09a23800 INFO              GST_STATES gstbin.c:2959:gst_bin_change_state_func:<pipeline0> child 'fakesink0' is changing state asynchronously to PAUSED
0:00:00.646866963  2962 0x55ee09a23800 INFO              GST_STATES gstbin.c:2503:gst_bin_element_set_state:<nvinfer0> current READY pending VOID_PENDING, desired next PAUSED
WARNING: [TRT]: CUDA lazy loading is not enabled. Enabling it can significantly reduce device memory usage. See `CUDA_MODULE_LOADING` in https://docs.nvidia.com/cuda/cuda-c-programming-guide/index.html#env-vars
WARNING: [TRT]: CUDA lazy loading is not enabled. Enabling it can significantly reduce device memory usage. See `CUDA_MODULE_LOADING` in https://docs.nvidia.com/cuda/cuda-c-programming-guide/index.html#env-vars
0:00:05.392172113  2962 0x55ee09a23800 INFO                 nvinfer gstnvinfer.cpp:682:gst_nvinfer_logger:<nvinfer0> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1988> [UID = 1]: deserialized trt engine from :/opt/nvidia/deepstream/deepstream-6.3/model_b1_gpu0_fp32.engine
WARNING: [TRT]: The getMaxBatchSize() function should not be used with an engine built from a network created with NetworkDefinitionCreationFlag::kEXPLICIT_BATCH flag. This function will always return 1.
INFO: ../nvdsinfer/nvdsinfer_model_builder.cpp:610 [Implicit Engine Info]: layers num: 2
0   INPUT  kFLOAT images          3x640x640       
1   OUTPUT kFLOAT output          8400x7          

0:00:05.542030072  2962 0x55ee09a23800 INFO                 nvinfer gstnvinfer.cpp:682:gst_nvinfer_logger:<nvinfer0> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2091> [UID = 1]: Use deserialized engine model: /opt/nvidia/deepstream/deepstream-6.3/model_b1_gpu0_fp32.engine
0:00:05.775935292  2962 0x55ee09a23800 INFO                 nvinfer gstnvinfer_impl.cpp:328:notifyLoadModelStatus:<nvinfer0> [UID 1]: Load new model:/opt/nvidia/deepstream/deepstream/ys.txt sucessfully
0:00:05.775967082  2962 0x55ee09a23800 INFO              GST_STATES gstelement.c:2688:gst_element_continue_state:<nvinfer0> completed state change to PAUSED
0:00:05.775976112  2962 0x55ee09a23800 INFO              GST_STATES gstelement.c:2588:_priv_gst_element_state_changed:<nvinfer0> notifying about state-changed READY to PAUSED (VOID_PENDING pending)
0:00:05.775995832  2962 0x55ee09a23800 INFO              GST_STATES gstbin.c:2952:gst_bin_change_state_func:<pipeline0> child 'nvinfer0' changed state to 3(PAUSED) successfully
0:00:05.776007362  2962 0x55ee09a23800 INFO              GST_STATES gstbin.c:2503:gst_bin_element_set_state:<mux> current READY pending VOID_PENDING, desired next PAUSED
0:00:05.778935464  2962 0x55ee09a23800 INFO              GST_STATES gstelement.c:2688:gst_element_continue_state:<mux> completed state change to PAUSED
0:00:05.778943704  2962 0x55ee09a23800 INFO              GST_STATES gstelement.c:2588:_priv_gst_element_state_changed:<mux> notifying about state-changed READY to PAUSED (VOID_PENDING pending)
0:00:05.778952094  2962 0x55ee09a23800 INFO              GST_STATES gstbin.c:2952:gst_bin_change_state_func:<pipeline0> child 'mux' changed state to 3(PAUSED) successfully
0:00:05.778958934  2962 0x55ee09a23800 INFO              GST_STATES gstbin.c:2503:gst_bin_element_set_state:<nvvideoconvert0> current READY pending VOID_PENDING, desired next PAUSED
0:00:05.778971004  2962 0x55ee09a23800 INFO              GST_STATES gstelement.c:2688:gst_element_continue_state:<nvvideoconvert0> completed state change to PAUSED
0:00:05.778974684  2962 0x55ee09a23800 INFO              GST_STATES gstelement.c:2588:_priv_gst_element_state_changed:<nvvideoconvert0> notifying about state-changed READY to PAUSED (VOID_PENDING pending)
0:00:05.778980604  2962 0x55ee09a23800 INFO              GST_STATES gstbin.c:2952:gst_bin_change_state_func:<pipeline0> child 'nvvideoconvert0' changed state to 3(PAUSED) successfully
0:00:05.778987064  2962 0x55ee09a23800 INFO              GST_STATES gstbin.c:2503:gst_bin_element_set_state:<avdec_h264-0> current READY pending VOID_PENDING, desired next PAUSED
0:00:05.779079344  2962 0x55ee09a23800 INFO              GST_STATES gstelement.c:2688:gst_element_continue_state:<avdec_h264-0> completed state change to PAUSED
0:00:05.779086244  2962 0x55ee09a23800 INFO              GST_STATES gstelement.c:2588:_priv_gst_element_state_changed:<avdec_h264-0> notifying about state-changed READY to PAUSED (VOID_PENDING pending)
0:00:05.779091175  2962 0x55ee09a23800 INFO              GST_STATES gstbin.c:2952:gst_bin_change_state_func:<pipeline0> child 'avdec_h264-0' changed state to 3(PAUSED) successfully
0:00:05.779100375  2962 0x55ee09a23800 INFO              GST_STATES gstbin.c:2503:gst_bin_element_set_state:<h264parse0> current READY pending VOID_PENDING, desired next PAUSED
0:00:05.779155984  2962 0x55ee09a23800 INFO                GST_PADS gstpad.c:4237:gst_pad_peer_query:<h264parse0:sink> pad has no peer
0:00:05.779232824  2962 0x55ee09a23800 INFO              GST_STATES gstelement.c:2688:gst_element_continue_state:<h264parse0> completed state change to PAUSED
0:00:05.779240824  2962 0x55ee09a23800 INFO              GST_STATES gstelement.c:2588:_priv_gst_element_state_changed:<h264parse0> notifying about state-changed READY to PAUSED (VOID_PENDING pending)
0:00:05.779245755  2962 0x55ee09a23800 INFO              GST_STATES gstbin.c:2952:gst_bin_change_state_func:<pipeline0> child 'h264parse0' changed state to 3(PAUSED) successfully
0:00:05.779256655  2962 0x55ee09a23800 INFO              GST_STATES gstbin.c:2503:gst_bin_element_set_state:<qtdemux0> current READY pending VOID_PENDING, desired next PAUSED
0:00:05.779278905  2962 0x55ee09a23800 INFO                 filesrc gstfilesrc.c:468:gst_file_src_start:<filesrc0> opening file samples/streams/sample_720p.mp4
0:00:05.779315015  2962 0x55ee09a23800 WARN                 basesrc gstbasesrc.c:3600:gst_base_src_start_complete:<filesrc0> pad not activated yet
0:00:05.779332035  2962 0x55ee09a23800 INFO                 filesrc gstfilesrc.c:468:gst_file_src_start:<filesrc0> opening file samples/streams/sample_720p.mp4
0:00:05.779361215  2962 0x55ee09a23800 INFO                    task gsttask.c:460:gst_task_set_lock: setting stream lock 0x55ee09c623e0 on task 0x55ee09c78a70
0:00:05.779367535  2962 0x55ee09a23800 INFO                GST_PADS gstpad.c:6159:gst_pad_start_task:<qtdemux0:sink> created task 0x55ee09c78a70
0:00:05.779445095  2962 0x55ee09a23800 INFO              GST_STATES gstelement.c:2688:gst_element_continue_state:<qtdemux0> completed state change to PAUSED
0:00:05.779451395  2962 0x55ee09a23800 INFO              GST_STATES gstelement.c:2588:_priv_gst_element_state_changed:<qtdemux0> notifying about state-changed READY to PAUSED (VOID_PENDING pending)
0:00:05.779457615  2962 0x55ee09a23800 INFO              GST_STATES gstbin.c:2952:gst_bin_change_state_func:<pipeline0> child 'qtdemux0' changed state to 3(PAUSED) successfully
0:00:05.779462995  2962 0x55ee09a23800 INFO              GST_STATES gstbin.c:2503:gst_bin_element_set_state:<filesrc0> current READY pending VOID_PENDING, desired next PAUSED
0:00:05.779471915  2962 0x55ee09a23800 INFO              GST_STATES gstelement.c:2688:gst_element_continue_state:<filesrc0> completed state change to PAUSED
0:00:05.779476895  2962 0x55ee09a23800 INFO              GST_STATES gstelement.c:2588:_priv_gst_element_state_changed:<filesrc0> notifying about state-changed READY to PAUSED (VOID_PENDING pending)
0:00:05.779481905  2962 0x55ee09a23800 INFO              GST_STATES gstbin.c:2952:gst_bin_change_state_func:<pipeline0> child 'filesrc0' changed state to 3(PAUSED) successfully
Pipeline is PREROLLING ...
0:00:05.779822675  2962 0x55ee09c70f00 WARN                 qtdemux qtdemux_types.c:239:qtdemux_type_get: unknown QuickTime node type sgpd
0:00:05.779868475  2962 0x55ee09c70f00 WARN                 qtdemux qtdemux_types.c:239:qtdemux_type_get: unknown QuickTime node type sbgp
0:00:05.779886275  2962 0x55ee09c70f00 INFO                 qtdemux qtdemux.c:14202:qtdemux_parse_tree:<qtdemux0> timescale: 1000
0:00:05.779896275  2962 0x55ee09c70f00 INFO                 qtdemux qtdemux.c:14203:qtdemux_parse_tree:<qtdemux0> duration: 48067
0:00:05.779950305  2962 0x55ee09c70f00 WARN                 qtdemux qtdemux.c:3250:qtdemux_parse_trex:<qtdemux0> failed to find fragment defaults for stream 1
0:00:05.780027505  2962 0x55ee09c70f00 INFO                 qtdemux qtdemux.c:11664:qtdemux_parse_trak:<qtdemux0> type avc1 caps video/x-h264, stream-format=(string)avc, alignment=(string)au, level=(string)3.1, profile=(string)high, codec_data=(buffer)0164001fffe100196764001facd9405005ba10000003001000000303c0f183196001000568ebecb22c
0:00:05.780123925  2962 0x55ee09c70f00 WARN                 qtdemux qtdemux.c:3250:qtdemux_parse_trex:<qtdemux0> failed to find fragment defaults for stream 2
0:00:05.780180565  2962 0x55ee09c70f00 INFO                 qtdemux qtdemux.c:12390:qtdemux_parse_trak:<qtdemux0> type mp4a caps audio/mpeg, mpegversion=(int)4, framed=(boolean)true, stream-format=(string)raw, level=(string)2, base-profile=(string)lc, profile=(string)lc, codec_data=(buffer)119056e500
0:00:05.780244365  2962 0x55ee09c70f00 INFO          GST_SCHEDULING gstpad.c:4898:gst_pad_get_range_unchecked:<filesrc0:src> getrange failed, flow: eos
0:00:05.780259496  2962 0x55ee09c70f00 INFO          GST_SCHEDULING gstpad.c:5113:gst_pad_pull_range:<qtdemux0:sink> pullrange failed, flow: eos
0:00:05.780357816  2962 0x55ee09c70f00 INFO               GST_EVENT gstevent.c:820:gst_event_new_caps: creating caps event video/x-h264, stream-format=(string)avc, alignment=(string)au, level=(string)3.1, profile=(string)high, codec_data=(buffer)0164001fffe100196764001facd9405005ba10000003001000000303c0f183196001000568ebecb22c, width=(int)1280, height=(int)720, framerate=(fraction)30/1, pixel-aspect-ratio=(fraction)1/1
0:00:05.780377925  2962 0x55ee09c70f00 INFO        GST_ELEMENT_PADS gstelement.c:671:gst_element_add_pad:<qtdemux0> adding pad 'video_0'
0:00:05.780405865  2962 0x55ee09c70f00 INFO            GST_PIPELINE grammar.y:520:gst_parse_found_pad: trying delayed linking one pad some pad of GstQTDemux named qtdemux0 to some pad of GstH264Parse named h264parse0
0:00:05.780419936  2962 0x55ee09c70f00 INFO        GST_ELEMENT_PADS gstutils.c:1771:gst_element_link_pads_full: trying to link element qtdemux0:(any) to element h264parse0:(any)
0:00:05.780435345  2962 0x55ee09c70f00 INFO                GST_PADS gstutils.c:1034:gst_pad_check_link: trying to link qtdemux0:video_0 and h264parse0:sink
0:00:05.780702446  2962 0x55ee09c70f00 INFO                GST_PADS gstutils.c:1587:prepare_link_maybe_ghosting: qtdemux0 and h264parse0 in same bin, no need for ghost pads
0:00:05.780724616  2962 0x55ee09c70f00 INFO                GST_PADS gstpad.c:2377:gst_pad_link_prepare: trying to link qtdemux0:video_0 and h264parse0:sink
0:00:05.780941646  2962 0x55ee09c70f00 INFO                GST_PADS gstpad.c:2585:gst_pad_link_full: linked qtdemux0:video_0 and h264parse0:sink, successful
0:00:05.780954946  2962 0x55ee09c70f00 INFO               GST_EVENT gstevent.c:1579:gst_event_new_reconfigure: creating reconfigure event
0:00:05.781027866  2962 0x55ee09c70f00 INFO               GST_EVENT gstevent.c:820:gst_event_new_caps: creating caps event audio/mpeg, mpegversion=(int)4, framed=(boolean)true, stream-format=(string)raw, level=(string)2, base-profile=(string)lc, profile=(string)lc, codec_data=(buffer)119056e500, rate=(int)48000, channels=(int)2
0:00:05.781044036  2962 0x55ee09c70f00 INFO        GST_ELEMENT_PADS gstelement.c:671:gst_element_add_pad:<qtdemux0> adding pad 'audio_0'
0:00:05.781089506  2962 0x55ee09c70f00 INFO               GST_EVENT gstevent.c:900:gst_event_new_segment: creating segment event time segment start=0:00:00.066666666, offset=0:00:00.000000000, stop=0:00:48.133666666, rate=1.000000, applied_rate=1.000000, flags=0x00, time=0:00:00.000000000, base=0:00:00.000000000, position 0:00:00.066666666, duration 99:99:99.999999999
0:00:05.781397226  2962 0x55ee09c70f00 INFO               baseparse gstbaseparse.c:4068:gst_base_parse_set_latency:<h264parse0> min/max latency 0:00:00.033333333, 0:00:00.033333333
0:00:05.781502257  2962 0x55ee09c70f00 INFO               GST_EVENT gstevent.c:820:gst_event_new_caps: creating caps event video/x-h264, stream-format=(string)avc, alignment=(string)au, level=(string)3.1, profile=(string)high, codec_data=(buffer)0164001fffe100196764001facd9405005ba10000003001000000303c0f183196001000568ebecb22c, width=(int)1280, height=(int)720, framerate=(fraction)30/1, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, chroma-format=(string)4:2:0, bit-depth-luma=(uint)8, bit-depth-chroma=(uint)8, parsed=(boolean)true
0:00:05.781815837  2962 0x55ee09c70f00 INFO                   libav :0:: Application has requested 256 threads. Using a thread count greater than 16 is not recommended.
0:00:05.801101094  2962 0x55ee09c70f00 INFO               baseparse gstbaseparse.c:4843:gst_base_parse_set_upstream_tags:<h264parse0> upstream tags: taglist, video-codec=(string)"H.264\ /\ AVC", language-code=(string)en, bitrate=(uint)2454874;
Redistribute latency...
0:00:05.801168883  2962 0x55ee09a23800 INFO               GST_EVENT gstevent.c:1449:gst_event_new_latency: creating latency event 0:00:00.000000000
0:00:05.801189263  2962 0x55ee09a23800 INFO                     bin gstbin.c:2783:gst_bin_do_latency_func:<pipeline0> configured latency of 0:00:00.000000000
0:00:05.801222674  2962 0x55ee09c70f00 INFO               baseparse gstbaseparse.c:4068:gst_base_parse_set_latency:<h264parse0> min/max latency 0:00:00.033333333, 0:00:00.033333333
0:00:05.801296884  2962 0x55ee09c70f00 INFO            videodecoder gstvideodecoder.c:1312:gst_video_decoder_sink_event_default:<avdec_h264-0> upstream tags: taglist, video-codec=(string)"H.264\ /\ AVC", language-code=(string)en, bitrate=(uint)2454874;
0:00:05.801326454  2962 0x55ee09c70f00 INFO            videodecoder gstvideodecoder.c:1312:gst_video_decoder_sink_event_default:<avdec_h264-0> upstream tags: taglist, video-codec=(string)"H.264\ \(High\ Profile\)", language-code=(string)en, bitrate=(uint)2454874;
0:00:05.801716854  2962 0x7f72b80046f0 INFO                   libav :0:: Reinit context to 1280x720, pix_fmt: yuv420p
0:00:05.804264366  2962 0x55ee09c70f00 INFO               GST_EVENT gstevent.c:900:gst_event_new_segment: creating segment event time segment start=0:00:00.021333333, offset=0:00:00.000000000, stop=0:00:47.999333333, rate=1.000000, applied_rate=1.000000, flags=0x00, time=0:00:00.000000000, base=0:00:00.000000000, position 0:00:00.021333333, duration 99:99:99.999999999
0:00:05.808501110  2962 0x55ee09c70f00 INFO            videodecoder gstvideodecoder.c:1312:gst_video_decoder_sink_event_default:<avdec_h264-0> upstream tags: taglist, video-codec=(string)"H.264\ \(High\ Profile\)", language-code=(string)en, bitrate=(uint)2454874, minimum-bitrate=(uint)7062240, maximum-bitrate=(uint)7062240;
0:00:05.809212590  2962 0x55ee09c70f00 INFO            videodecoder gstvideodecoder.c:1312:gst_video_decoder_sink_event_default:<avdec_h264-0> upstream tags: taglist, video-codec=(string)"H.264\ \(High\ Profile\)", language-code=(string)en, bitrate=(uint)2454874, minimum-bitrate=(uint)3430080, maximum-bitrate=(uint)7062240;
0:00:05.809908891  2962 0x55ee09c70f00 INFO            videodecoder gstvideodecoder.c:1312:gst_video_decoder_sink_event_default:<avdec_h264-0> upstream tags: taglist, video-codec=(string)"H.264\ \(High\ Profile\)", language-code=(string)en, bitrate=(uint)2454874, minimum-bitrate=(uint)2374800, maximum-bitrate=(uint)7062240;
0:00:05.813349524  2962 0x55ee09c70f00 INFO            videodecoder gstvideodecoder.c:1312:gst_video_decoder_sink_event_default:<avdec_h264-0> upstream tags: taglist, video-codec=(string)"H.264\ \(High\ Profile\)", language-code=(string)en, bitrate=(uint)2454874, minimum-bitrate=(uint)2336160, maximum-bitrate=(uint)7062240;
0:00:05.815347975  2962 0x55ee09c70f00 INFO            videodecoder gstvideodecoder.c:1312:gst_video_decoder_sink_event_default:<avdec_h264-0> upstream tags: taglist, video-codec=(string)"H.264\ \(High\ Profile\)", language-code=(string)en, bitrate=(uint)2454874, minimum-bitrate=(uint)2261520, maximum-bitrate=(uint)7062240;
0:00:05.816056626  2962 0x55ee09c70f00 INFO            videodecoder gstvideodecoder.c:1312:gst_video_decoder_sink_event_default:<avdec_h264-0> upstream tags: taglist, video-codec=(string)"H.264\ \(High\ Profile\)", language-code=(string)en, bitrate=(uint)2454874, minimum-bitrate=(uint)2193600, maximum-bitrate=(uint)7062240;
0:00:05.816782647  2962 0x55ee09c70f00 INFO            videodecoder gstvideodecoder.c:1312:gst_video_decoder_sink_event_default:<avdec_h264-0> upstream tags: taglist, video-codec=(string)"H.264\ \(High\ Profile\)", language-code=(string)en, bitrate=(uint)2454874, minimum-bitrate=(uint)2164080, maximum-bitrate=(uint)7062240;
0:00:05.817518817  2962 0x55ee09c70f00 INFO            videodecoder gstvideodecoder.c:1312:gst_video_decoder_sink_event_default:<avdec_h264-0> upstream tags: taglist, video-codec=(string)"H.264\ \(High\ Profile\)", language-code=(string)en, bitrate=(uint)2454874, minimum-bitrate=(uint)1883520, maximum-bitrate=(uint)7062240;
0:00:05.818236388  2962 0x55ee09c70f00 INFO            videodecoder gstvideodecoder.c:1312:gst_video_decoder_sink_event_default:<avdec_h264-0> upstream tags: taglist, video-codec=(string)"H.264\ \(High\ Profile\)", language-code=(string)en, bitrate=(uint)2454874, minimum-bitrate=(uint)1808400, maximum-bitrate=(uint)7062240;
0:00:05.818844088  2962 0x55ee09c70f00 INFO            videodecoder gstvideodecoder.c:1312:gst_video_decoder_sink_event_default:<avdec_h264-0> upstream tags: taglist, video-codec=(string)"H.264\ \(High\ Profile\)", language-code=(string)en, bitrate=(uint)2454874, minimum-bitrate=(uint)1106640, maximum-bitrate=(uint)7062240;
0:00:05.820892290  2962 0x55ee09c70f00 INFO            videodecoder gstvideodecoder.c:1312:gst_video_decoder_sink_event_default:<avdec_h264-0> upstream tags: taglist, video-codec=(string)"H.264\ \(High\ Profile\)", language-code=(string)en, bitrate=(uint)2454874, minimum-bitrate=(uint)834960, maximum-bitrate=(uint)7062240;
0:00:05.822469791  2962 0x55ee09c70f00 INFO            videodecoder gstvideodecoder.c:1312:gst_video_decoder_sink_event_default:<avdec_h264-0> upstream tags: taglist, video-codec=(string)"H.264\ \(High\ Profile\)", language-code=(string)en, bitrate=(uint)2454874, minimum-bitrate=(uint)834960, maximum-bitrate=(uint)8221920;
0:00:05.826493195  2962 0x55ee09c70f00 INFO            videodecoder gstvideodecoder.c:1312:gst_video_decoder_sink_event_default:<avdec_h264-0> upstream tags: taglist, video-codec=(string)"H.264\ \(High\ Profile\)", language-code=(string)en, bitrate=(uint)2454874, minimum-bitrate=(uint)496080, maximum-bitrate=(uint)8221920;
0:00:05.828268636  2962 0x55ee09c70f00 INFO            videodecoder gstvideodecoder.c:1312:gst_video_decoder_sink_event_default:<avdec_h264-0> upstream tags: taglist, video-codec=(string)"H.264\ \(High\ Profile\)", language-code=(string)en, bitrate=(uint)2454874, minimum-bitrate=(uint)429360, maximum-bitrate=(uint)8221920;
0:00:05.851133346  2962 0x55ee09c70f00 INFO            videodecoder gstvideodecoder.c:1312:gst_video_decoder_sink_event_default:<avdec_h264-0> upstream tags: taglist, video-codec=(string)"H.264\ \(High\ Profile\)", language-code=(string)en, bitrate=(uint)2454874, minimum-bitrate=(uint)429360, maximum-bitrate=(uint)9292320;
0:00:05.854968839  2962 0x55ee09c70f00 INFO            videodecoder gstvideodecoder.c:1312:gst_video_decoder_sink_event_default:<avdec_h264-0> upstream tags: taglist, video-codec=(string)"H.264\ \(High\ Profile\)", language-code=(string)en, bitrate=(uint)2454874, minimum-bitrate=(uint)377040, maximum-bitrate=(uint)9292320;
0:00:05.855541490  2962 0x55ee09c70f00 INFO            videodecoder gstvideodecoder.c:1312:gst_video_decoder_sink_event_default:<avdec_h264-0> upstream tags: taglist, video-codec=(string)"H.264\ \(High\ Profile\)", language-code=(string)en, bitrate=(uint)2454874, minimum-bitrate=(uint)291600, maximum-bitrate=(uint)9292320;
0:00:05.894273233  2962 0x55ee09c70f00 INFO            videodecoder gstvideodecoder.c:1312:gst_video_decoder_sink_event_default:<avdec_h264-0> upstream tags: taglist, video-codec=(string)"H.264\ \(High\ Profile\)", language-code=(string)en, bitrate=(uint)2454874, minimum-bitrate=(uint)291600, maximum-bitrate=(uint)9820800;
0:00:05.896733095  2962 0x55ee09c70f00 INFO            videodecoder gstvideodecoder.c:1312:gst_video_decoder_sink_event_default:<avdec_h264-0> upstream tags: taglist, video-codec=(string)"H.264\ \(High\ Profile\)", language-code=(string)en, bitrate=(uint)2454874, minimum-bitrate=(uint)291600, maximum-bitrate=(uint)12928800;
0:00:05.990481565  2962 0x55ee09c70f00 INFO            videodecoder gstvideodecoder.c:1312:gst_video_decoder_sink_event_default:<avdec_h264-0> upstream tags: taglist, video-codec=(string)"H.264\ \(High\ Profile\)", language-code=(string)en, bitrate=(uint)2454874, minimum-bitrate=(uint)291600, maximum-bitrate=(uint)23253360;
0:00:05.997204821  2962 0x55ee09c70f00 INFO               GST_EVENT gstevent.c:820:gst_event_new_caps: creating caps event video/x-raw, format=(string)I420, width=(int)1280, height=(int)720, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, chroma-site=(string)mpeg2, colorimetry=(string)bt709, framerate=(fraction)30/1
0:00:05.999073963  2962 0x55ee09c70f00 INFO               GST_EVENT gstevent.c:820:gst_event_new_caps: creating caps event video/x-raw(memory:NVMM), multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, format=(string)NV12, framerate=(fraction)30/1, width=(int)1280, height=(int)720, interlace-mode=(string)progressive, pixel-aspect-ratio=(fraction)1/1, block-linear=(boolean)false, nvbuf-memory-type=(string)nvbuf-mem-cuda-device, gpu-id=(int)0
0:00:05.999179603  2962 0x55ee09c70f00 INFO               GST_EVENT gstevent.c:820:gst_event_new_caps: creating caps event video/x-raw(memory:NVMM), multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, format=(string)NV12, framerate=(fraction)30/1, width=(int)704, height=(int)576, block-linear=(boolean)false, nvbuf-memory-type=(string)nvbuf-mem-cuda-device, gpu-id=(int)0, batch-size=(int)1, num-surfaces-per-frame=(int)1
0:00:05.999280353  2962 0x55ee09c70f00 INFO           basetransform gstbasetransform.c:1317:gst_base_transform_setcaps:<nvinfer0> reuse caps
0:00:05.999307493  2962 0x55ee09c70f00 INFO               GST_EVENT gstevent.c:820:gst_event_new_caps: creating caps event video/x-raw(memory:NVMM), multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, format=(string)NV12, framerate=(fraction)30/1, width=(int)704, height=(int)576, block-linear=(boolean)false, nvbuf-memory-type=(string)nvbuf-mem-cuda-device, gpu-id=(int)0, batch-size=(int)1, num-surfaces-per-frame=(int)1
0:00:05.999439653  2962 0x55ee09c70f00 INFO                    task gsttask.c:460:gst_task_set_lock: setting stream lock 0x55ee09c63410 on task 0x7f6e55f1e5f0
0:00:05.999457323  2962 0x55ee09c70f00 INFO                GST_PADS gstpad.c:6159:gst_pad_start_task:<mux:src> created task 0x7f6e55f1e5f0
0:00:05.999626123  2962 0x55ee09c70f00 INFO             nvstreammux gstnvstreammux.cpp:1427:gst_nvstreammux_sink_event:<mux> Conversion enabled for source 0
Redistribute latency...
0:00:05.999842193  2962 0x55ee09a23800 INFO               GST_EVENT gstevent.c:1449:gst_event_new_latency: creating latency event 0:00:00.000000000
0:00:05.999873313  2962 0x55ee09a23800 INFO                     bin gstbin.c:2783:gst_bin_do_latency_func:<pipeline0> configured latency of 0:00:00.000000000
0:00:05.999888853  2962 0x55ee09c71180 INFO               GST_EVENT gstevent.c:900:gst_event_new_segment: creating segment event time segment start=0:00:00.000000000, offset=0:00:00.000000000, stop=99:99:99.999999999, rate=1.000000, applied_rate=1.000000, flags=0x00, time=0:00:00.000000000, base=0:00:00.000000000, position 0:00:00.000000000, duration 99:99:99.999999999
0:00:06.000476324  2962 0x55ee09c70f00 INFO             nvstreammux gstnvstreammux.cpp:1467:gst_nvstreammux_sink_event:<mux> mux got segment from src 0 time segment start=0:00:00.066666666, offset=0:00:00.000000000, stop=0:00:48.133666666, rate=1.000000, applied_rate=1.000000, flags=0x00, time=0:00:00.000000000, base=0:00:00.000000000, position 0:00:00.066666666, duration 99:99:99.999999999
0:00:06.000541484  2962 0x55ee09c70f00 INFO            videodecoder gstvideodecoder.c:3184:gst_video_decoder_clip_and_push_buf:<avdec_h264-0> First buffer since flush took 0:00:00.221538150 to produce
Caught SIGSEGV
#0  0x00007f740468499f in poll () at /usr/lib/x86_64-linux-gnu/libc.so.6
#1  0x00007f74047d936e in  () at /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0
#2  0x00007f74047d96f3 in g_main_loop_run ()
#3  0x00007f740495aab3 in gst_bus_poll ()
#4  0x000055ee0900e6e5 in  ()
#5  0x000055ee0900d8ff in  ()
#6  0x00007f7404596083 in __libc_start_main ()
#7  0x000055ee0900dc0e in  ()
Spinning.  Please run 'gdb gst-launch-1.0 2962' to continue debugging, Ctrl-C to quit, or Ctrl-\ to dump core.
^[[A^[[A^Chandling interrupt.
Interrupt: Stopping pipeline ...
ERROR: pipeline doesn't want to preroll.
Setting pipeline to NULL ...
0:01:04.208612093  2962 0x55ee09a23800 INFO              GST_STATES gstbin.c:2503:gst_bin_element_set_state:<fakesink0> current READY pending PAUSED, desired next READY
0:01:04.208678763  2962 0x55ee09a23800 INFO              GST_STATES gstelement.c:2688:gst_element_continue_state:<fakesink0> completed state change to READY
0:01:04.208699083  2962 0x55ee09a23800 INFO              GST_STATES gstelement.c:2588:_priv_gst_element_state_changed:<fakesink0> notifying about state-changed READY to READY (VOID_PENDING pending)
0:01:04.208715273  2962 0x55ee09a23800 INFO              GST_STATES gstbin.c:2952:gst_bin_change_state_func:<pipeline0> child 'fakesink0' changed state to 2(READY) successfully
0:01:04.208732873  2962 0x55ee09a23800 INFO              GST_STATES gstbin.c:2503:gst_bin_element_set_state:<nvinfer0> current PAUSED pending VOID_PENDING, desired next READY
LrWm3 commented 10 months ago

I believe it is something to do with the parser. I still don't really understand why my onnx model was not producing the right dimensions. But I was able to work around it compiling the example below and using NvDsInferParseYoloV7 as the class

https://raw.githubusercontent.com/NVIDIA-AI-IOT/yolo_deepstream/main/deepstream_yolo/nvdsinfer_custom_impl_Yolo/nvdsparsebbox_Yolo.cpp

edit: I thought it worked but it didn't really. no segfault but I believe it was not parsing the output correctly.

marcoslucianops commented 10 months ago

The export_yolox.py should have the correct output for the parser (3 outputs). Are you using the latest export_yolox.py from this repo?

marcoslucianops commented 10 months ago
git clone https://github.com/Megvii-BaseDetection/YOLOX.git
cd YOLOX
pip3 install -r requirements.txt
python3 setup.py develop
pip3 install onnx onnxsim onnxruntime
cp ../DeepStream-Yolo/utils/export_yolox.py .
wget https://github.com/Megvii-BaseDetection/YOLOX/releases/download/0.1.1rc0/yolox_s.pth
python3 export_yolox.py -w yolox_s.pth -c exps/default/yolox_s.py --dynamic
cd ../DeepStream-Yolo
CUDA_VER=12.1 make -C nvdsinfer_custom_impl_Yolo

Jusr converted following these steps and the output is correct

image

lrwm3-bot commented 10 months ago

I believe it is something in my config. When I test the generated model with the onnx python lib, I see the three outputs. It's only when I use it with nvinfer that it shows the single output with unexpected dimensions. Will check again tomorrow.

marcoslucianops commented 10 months ago

Maybe you are using a old engine with wrong output. Please delete it and try to generate again with the exported ONNX model.

LrWm3 commented 10 months ago

Ahh, I didn't understand the engine file. Removing it and rerunning solved the issue for yolox_s.oonx. I was originally trying this with another model I had and it wasn't working.

Appreciate all the help!