Closed HappyKerry closed 10 months ago
@HappyKerry I think you might be asking too much from your pipeline/device. From your inference config file, I see that you are on a Jetson device... which one? What is the frame-rate of your recorded videos?
Having a two GIE's, both with the inference-interval
set to 0, a DCF Tracker, and a high-frame rate might be causing the issue.
The first thing I would try is to set the inference-interval
on your GIEs to something other than 0. Try 4 to start with.
Second, in the current release branch that I'm working on (v0.27.alpha) I've added the ability to control/adjust the frame-rate. So just as a test, if you move to the latest release, you can reduce the frame-rate into the GIE's buy calling dsl_source_video_buffer_out_frame_rate_set
to see if you can get your Pipeline to run.
Let's first determine if this is a gpu/cpu limitation or perhaps some other issue with DSL.
@HappyKerry if you do upgrade, there are a few changes that you will need to make in your code. See issue #1004
The example ode_cross_polygon_border_print_event.cpp
has been updated in this branch
@HappyKerry I think you might be asking too much from your pipeline/device. From your inference config file, I see that you are on a Jetson device... which one? What is the frame-rate of your recorded videos?
Having a two GIE's, both with the
inference-interval
set to 0, a DCF Tracker, and a high-frame rate might be causing the issue.The first thing I would try is to set the
inference-interval
on your GIEs to something other than 0. Try 4 to start with.Second, in the current release branch that I'm working on (v0.27.alpha) I've added the ability to control/adjust the frame-rate. So just as a test, if you move to the latest release, you can reduce the frame-rate into the GIE's buy calling
dsl_source_video_buffer_out_frame_rate_set
to see if you can get your Pipeline to run.Let's first determine if this is a gpu/cpu limitation or perhaps some other issue with DSL.
I am tesing on tesla v100,not on jetson, I changed the code to v0.27.alpha, stuck also happened, there might some bugs here
@HappyKerry I think you might be asking too much from your pipeline/device. From your inference config file, I see that you are on a Jetson device... which one? What is the frame-rate of your recorded videos?
Having a two GIE's, both with the
inference-interval
set to 0, a DCF Tracker, and a high-frame rate might be causing the issue.The first thing I would try is to set the
inference-interval
on your GIEs to something other than 0. Try 4 to start with.Second, in the current release branch that I'm working on (v0.27.alpha) I've added the ability to control/adjust the frame-rate. So just as a test, if you move to the latest release, you can reduce the frame-rate into the GIE's buy calling
dsl_source_video_buffer_out_frame_rate_set
to see if you can get your Pipeline to run.Let's first determine if this is a gpu/cpu limitation or perhaps some other issue with DSL.
I am tesing on tesla v100,not on jetson, I changed the code to v0.27.alpha, stuck also happened, there might some bugs here
@HappyKerry please try with inference-interval = 4 for both gies ... the results of this will be very helpful
@HappyKerry please try with inference-interval = 4 for both gies ... the results of this will be very helpful @rjhowell44 I try with inference-interval=4 for both gies, dsl stuck also hanppened
and I move the two gies to deepstream , it can run correctly with interval 0 or 4
@HappyKerry thanks for the above, it is very helpful.
First, the fact that you can run in deepstream (I'm assuming you mean the deepstream_app or some other example) means we will be able to get it running is DSL.
Second, we have dozens of test cases, examples, and users (that I know of) that are using multiple gies, so your general use case is nothing new... so I need to understand your specific use case in more detail.
Looking at your log file, I don't see anything out of the ordinary, except for the final statement.
DSL src/DslPipelineStateMgr.cpp:325:HandleBusWatchMessage:�[00m : Unhandled message type:: latency
Unfortunately, we don't know which plugin is reporting the latency issue in the current release (something that will be addressed in the next release).
All that said, there are a couple of quick tests I would like you to try just to get more data.
sync
property for the file-sink to false. see dsl_sink_sync_enabled_setBeyond that, the easiest way to move forward, without a bunch of back and forth, would be to produce a Pipeline graph from both the deepstream-app pipeline and DSL pipeline... although, I'm more interested in the working case with deepstream.
Let me know if this is something you are willing and can do. Happy to provide details on how to capture if need be.
P.S. can you tell me which deepstream example and config-file you used?
@HappyKerry thanks for the above, it is very helpful.
First, the fact that you can run in deepstream (I'm assuming you mean the deepstream_app or some other example) means we will be able to get it running is DSL.
Second, we have dozens of test cases, examples, and users (that I know of) that are using multiple gies, so your general use case is nothing new... so I need to understand your specific use case in more detail.
Looking at your log file, I don't see anything out of the ordinary, except for the final statement.
DSL src/DslPipelineStateMgr.cpp:325:HandleBusWatchMessage:�[00m : Unhandled message type:: latency
Unfortunately, we don't know which plugin is reporting the latency issue in the current release (something that will be addressed in the next release).
All that said, there are a couple of quick tests I would like you to try just to get more data.
- can you try replacing the file-sink with a window-sink, to see if it still gets stuck.
- can you try setting the
sync
property for the file-sink to false. see dsl_sink_sync_enabled_setBeyond that, the easiest way to move forward, without a bunch of back and forth, would be to produce a Pipeline graph from both the deepstream-app pipeline and DSL pipeline... although, I'm more interested in the working case with deepstream.
Let me know if this is something you are willing and can do. Happy to provide details on how to capture if need be.
P.S. can you tell me which deepstream example and config-file you used?
I set the sync property for the file-sink to false, it is also stucked, but when i remove the secondary gie, the pipeline runs ok
@HappyKerry please provide me with a full log including a gstreamer/deepstream plugins
export GST_DEBUG=4
Is this problem solved? I'm also having the same issue
I didn't have any inconveniences with SGIE, but it would be better if you shared the SGIE configuration.
I didn't have any inconveniences with SGIE, but it would be better if you shared the SGIE configuration.
2uri_file_pgie_iou_tracker_3sgie_tiler_osd_custom_pph_window.py I ran this example, the configuration files are the default ones
@MintyLee please provide logs...
export GST_DEBUG=1,DSL:4
Please provide details on your Platform (dGPU or Jetson), DS Version, etc.
@MintyLee please provide logs...
export GST_DEBUG=1,DSL:4
Please provide details on your Platform (dGPU or Jetson), DS Version, etc.
Platform:dGPU, [GeForce RTX 3070], DeepStream6.3(by the way, this issue appears on deepstream6.3, which does not appear on deepstream6.2, but does not rule out other factors),Graphic card driver:525.125.06, deepstream-services-library: 0.27.alpha
The log is displayed as follows:
0:00:00.006754112 3241738 0x38c78c0 INFO DSL src/DslServices.cpp:136:GetServices: : Services Initialization 0:00:00.006794870 3241738 0x38c78c0 INFO DSL src/DslServicesInfo.cpp:58:InfoInitDebugSettings: : Pre-start log level = 1,DSL:4 0:00:00.006798117 3241738 0x38c78c0 INFO DSL src/DslServicesInfo.cpp:59:InfoInitDebugSettings: : Pre-start Log file = 0:00:00.006970306 3241738 0x38c78c0 INFO DSL src/DslServices.cpp:154:GetServices: : DSL Version: v0.27.alpha 0:00:00.007553124 3241738 0x38c78c0 INFO DSL src/DslServices.cpp:165:GetServices: : Libcurl Initialized Successfully 0:00:00.007557540 3241738 0x38c78c0 INFO DSL src/DslServices.cpp:166:GetServices: : Version: 7.68.0 0:00:00.007560371 3241738 0x38c78c0 INFO DSL src/DslServices.cpp:167:GetServices: : Host: x86_64-pc-linux-gnu 0:00:00.007563784 3241738 0x38c78c0 INFO DSL src/DslServices.cpp:168:GetServices: : Features: 12568477 0:00:00.007566220 3241738 0x38c78c0 INFO DSL src/DslServices.cpp:169:GetServices: : SSL Version: OpenSSL/1.1.1f 0:00:00.007568351 3241738 0x38c78c0 INFO DSL src/DslServices.cpp:170:GetServices: : Libz Version: 1.2.11 0:00:00.007571364 3241738 0x38c78c0 INFO DSL src/DslServices.cpp:171:GetServices: : Protocols: 0x7fa788912100 0:00:00.016262197 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1977:SetFileUri: : File Path = file:/opt/nvidia/deepstream/deepstream-6.3/samples/streams/sample_1080p_h265.mp4 0:00:00.020243115 3241738 0x38c78c0 INFO DSL src/ffmpeg/DslAvFile.cpp:78:AvInputFile: : Video codec data found in media file: /opt/nvidia/deepstream/deepstream/samples/streams/sample_1080p_h265.mp4 0:00:00.020258586 3241738 0x38c78c0 INFO DSL src/ffmpeg/DslAvFile.cpp:79:AvInputFile: : dimensions : 1920x1080 0:00:00.020262150 3241738 0x38c78c0 INFO DSL src/ffmpeg/DslAvFile.cpp:80:AvInputFile: : frame-rate : 30/1 0:00:00.020289740 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1944:SetUri: : URI Path for File Source 'uri-h264' = file:/opt/nvidia/deepstream/deepstream-6.3/samples/streams/sample_1080p_h265.mp4 0:00:00.020312372 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1892:UriSourceBintr: : 0:00:00.020315471 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1893:UriSourceBintr: : Initial property values for UriSourceBintr 'uri-h264' 0:00:00.020319166 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1894:UriSourceBintr: : uri : file:/opt/nvidia/deepstream/deepstream-6.3/samples/streams/sample_1080p_h265.mp4 0:00:00.020322546 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1895:UriSourceBintr: : is-live : 0 0:00:00.020325152 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1896:UriSourceBintr: : skip-frames : 0 0:00:00.020327095 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1897:UriSourceBintr: : drop-frame-interval : 0 0:00:00.020330188 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1898:UriSourceBintr: : width : 1920 0:00:00.020334370 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1899:UriSourceBintr: : height : 1080 0:00:00.020336400 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1900:UriSourceBintr: : fps-n : 30 0:00:00.020339566 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1901:UriSourceBintr: : fps-d : 1 0:00:00.020341670 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1902:UriSourceBintr: : media-out : video/x-raw(memory:NVMM) 0:00:00.020345684 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1903:UriSourceBintr: : buffer-out : 0:00:00.020348542 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1904:UriSourceBintr: : format : NV12 0:00:00.020351230 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1905:UriSourceBintr: : width : 0 0:00:00.020354265 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1906:UriSourceBintr: : height : 0 0:00:00.020356656 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1907:UriSourceBintr: : fps-n : 0 0:00:00.020358950 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1908:UriSourceBintr: : fps-d : 0 0:00:00.020361224 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1909:UriSourceBintr: : crop-pre-conv : 0:0:0:0 0:00:00.020363594 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1910:UriSourceBintr: : crop-post-conv : 0:0:0:0 0:00:00.020365775 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1911:UriSourceBintr: : orientation : 0 0:00:00.020410399 3241738 0x38c78c0 INFO DSL src/DslServicesSource.cpp:813:SourceUriNew: : New URI Source 'uri-h264' created successfully 0:00:00.020675505 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1977:SetFileUri: : File Path = file:/opt/nvidia/deepstream/deepstream-6.3/samples/streams/sample_1080p_h265.mp4 0:00:00.023465225 3241738 0x38c78c0 INFO DSL src/ffmpeg/DslAvFile.cpp:78:AvInputFile: : Video codec data found in media file: /opt/nvidia/deepstream/deepstream/samples/streams/sample_1080p_h265.mp4 0:00:00.023473071 3241738 0x38c78c0 INFO DSL src/ffmpeg/DslAvFile.cpp:79:AvInputFile: : dimensions : 1920x1080 0:00:00.023476319 3241738 0x38c78c0 INFO DSL src/ffmpeg/DslAvFile.cpp:80:AvInputFile: : frame-rate : 30/1 0:00:00.023498248 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1944:SetUri: : URI Path for File Source 'uri-h265' = file:/opt/nvidia/deepstream/deepstream-6.3/samples/streams/sample_1080p_h265.mp4 0:00:00.023518690 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1892:UriSourceBintr: : 0:00:00.023521810 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1893:UriSourceBintr: : Initial property values for UriSourceBintr 'uri-h265' 0:00:00.023525254 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1894:UriSourceBintr: : uri : file:/opt/nvidia/deepstream/deepstream-6.3/samples/streams/sample_1080p_h265.mp4 0:00:00.023529025 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1895:UriSourceBintr: : is-live : 0 0:00:00.023531979 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1896:UriSourceBintr: : skip-frames : 0 0:00:00.023535099 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1897:UriSourceBintr: : drop-frame-interval : 0 0:00:00.023538030 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1898:UriSourceBintr: : width : 1920 0:00:00.023540860 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1899:UriSourceBintr: : height : 1080 0:00:00.023543771 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1900:UriSourceBintr: : fps-n : 30 0:00:00.023546574 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1901:UriSourceBintr: : fps-d : 1 0:00:00.023549667 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1902:UriSourceBintr: : media-out : video/x-raw(memory:NVMM) 0:00:00.023552675 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1903:UriSourceBintr: : buffer-out : 0:00:00.023555546 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1904:UriSourceBintr: : format : NV12 0:00:00.023558312 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1905:UriSourceBintr: : width : 0 0:00:00.023560945 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1906:UriSourceBintr: : height : 0 0:00:00.023563808 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1907:UriSourceBintr: : fps-n : 0 0:00:00.023566524 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1908:UriSourceBintr: : fps-d : 0 0:00:00.023569519 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1909:UriSourceBintr: : crop-pre-conv : 0:0:0:0 0:00:00.023572321 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1910:UriSourceBintr: : crop-post-conv : 0:0:0:0 0:00:00.023575198 3241738 0x38c78c0 INFO DSL src/DslSourceBintr.cpp:1911:UriSourceBintr: : orientation : 0 0:00:00.023607402 3241738 0x38c78c0 INFO DSL src/DslServicesSource.cpp:813:SourceUriNew: : New URI Source 'uri-h265' created successfully 0:00:00.048409134 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:99:InferBintr: : 0:00:00.048420904 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp💯InferBintr: : Initial property values for InferBintr 'pgie' 0:00:00.048425207 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:101:InferBintr: : Inference Type : nvinfer 0:00:00.048427812 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:102:InferBintr: : config-file-path : /opt/nvidia/deepstream/deepstream/samples/configs/deepstream-app/config_infer_primary.txt 0:00:00.048430680 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:103:InferBintr: : process-mode : 1 0:00:00.048432985 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:104:InferBintr: : unique-id : 1 0:00:00.048435220 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:105:InferBintr: : interval : 3 0:00:00.048437527 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:106:InferBintr: : model-engine-file : /opt/nvidia/deepstream/deepstream/samples/models/Primary_Detector/resnet10.caffemodel_b8_gpu0_int8.engine 0:00:00.048581155 3241738 0x38c78c0 INFO DSL src/DslServicesInfer.cpp:70:InferPrimaryGieNew: : New Primary GIE 'pgie' created successfully 0:00:00.048794807 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:99:InferBintr: : 0:00:00.048798079 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp💯InferBintr: : Initial property values for InferBintr 'carcolor-sgie' 0:00:00.048801061 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:101:InferBintr: : Inference Type : nvinfer 0:00:00.048803608 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:102:InferBintr: : config-file-path : /opt/nvidia/deepstream/deepstream/samples/configs/deepstream-app/config_infer_secondary_carcolor.txt 0:00:00.048806162 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:103:InferBintr: : process-mode : 2 0:00:00.048808373 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:104:InferBintr: : unique-id : 2 0:00:00.048810659 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:105:InferBintr: : interval : 0 0:00:00.048812955 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:106:InferBintr: : model-engine-file : /opt/nvidia/deepstream/deepstream/samples/models/Secondary_CarColor/resnet18.caffemodel_b8_gpu0_int8.engine 0:00:00.048917247 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:570:SecondaryInferBintr: : Infer on name : pgie 0:00:00.048923685 3241738 0x38c78c0 INFO DSL src/DslServicesInfer.cpp:158:InferSecondaryGieNew: : New Secondary GIE 'carcolor-sgie' created successfully 0:00:00.049086864 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:99:InferBintr: : 0:00:00.049089856 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp💯InferBintr: : Initial property values for InferBintr 'carmake-sgie' 0:00:00.049092638 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:101:InferBintr: : Inference Type : nvinfer 0:00:00.049095044 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:102:InferBintr: : config-file-path : /opt/nvidia/deepstream/deepstream/samples/configs/deepstream-app/config_infer_secondary_carmake.txt 0:00:00.049097352 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:103:InferBintr: : process-mode : 2 0:00:00.049099716 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:104:InferBintr: : unique-id : 3 0:00:00.049101844 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:105:InferBintr: : interval : 0 0:00:00.049104037 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:106:InferBintr: : model-engine-file : /opt/nvidia/deepstream/deepstream/samples/models/Secondary_CarMake/resnet18.caffemodel_b8_gpu0_int8.engine 0:00:00.049149225 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:570:SecondaryInferBintr: : Infer on name : pgie 0:00:00.049153641 3241738 0x38c78c0 INFO DSL src/DslServicesInfer.cpp:158:InferSecondaryGieNew: : New Secondary GIE 'carmake-sgie' created successfully 0:00:00.049283412 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:99:InferBintr: : 0:00:00.049285924 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp💯InferBintr: : Initial property values for InferBintr 'vehicletype-sgie' 0:00:00.049288632 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:101:InferBintr: : Inference Type : nvinfer 0:00:00.049290910 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:102:InferBintr: : config-file-path : /opt/nvidia/deepstream/deepstream/samples/configs/deepstream-app/config_infer_secondary_vehicletypes.txt 0:00:00.049293179 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:103:InferBintr: : process-mode : 2 0:00:00.049295332 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:104:InferBintr: : unique-id : 4 0:00:00.049297518 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:105:InferBintr: : interval : 0 0:00:00.049299657 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:106:InferBintr: : model-engine-file : /opt/nvidia/deepstream/deepstream/samples/models/Secondary_VehicleTypes/resnet18.caffemodel_b8_gpu0_int8.engine 0:00:00.049344901 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:570:SecondaryInferBintr: : Infer on name : pgie 0:00:00.049348961 3241738 0x38c78c0 INFO DSL src/DslServicesInfer.cpp:158:InferSecondaryGieNew: : New Secondary GIE 'vehicletype-sgie' created successfully 0:00:00.049366680 3241738 0x38c78c0 INFO DSL src/DslServicesTracker.cpp:51:TrackerNew: : Tracker config file: /opt/nvidia/deepstream/deepstream/samples/configs/deepstream-app/config_tracker_IOU.yml
(python3:3241738): GLib-GObject-WARNING **: 10:21:34.873: g_object_get_is_valid_property: object class 'GstNvTracker' has no property named 'enable-batch-process'
(python3:3241738): GLib-GObject-WARNING *: 10:21:34.873: g_object_get_is_valid_property: object class 'GstNvTracker' has no property named 'enable-past-frame'
0:00:00.049765873 3241738 0x38c78c0 INFO DSL src/DslTrackerBintr.cpp:60:TrackerBintr: :
0:00:00.049769563 3241738 0x38c78c0 INFO DSL src/DslTrackerBintr.cpp:61:TrackerBintr: : Initial property values for TrackerBintr 'iou-tracker'
0:00:00.049772094 3241738 0x38c78c0 INFO DSL src/DslTrackerBintr.cpp:62:TrackerBintr: : tracker-width : 480
0:00:00.049774465 3241738 0x38c78c0 INFO DSL src/DslTrackerBintr.cpp:63:TrackerBintr: : tracker-height : 272
0:00:00.049777030 3241738 0x38c78c0 INFO DSL src/DslTrackerBintr.cpp:64:TrackerBintr: : ll-lib-file : /opt/nvidia/deepstream/deepstream/lib/libnvds_nvmultiobjecttracker.so
0:00:00.049779405 3241738 0x38c78c0 INFO DSL src/DslTrackerBintr.cpp:65:TrackerBintr: : ll-config-file : /opt/nvidia/deepstream/deepstream/samples/configs/deepstream-app/config_tracker_IOU.yml
0:00:00.049782028 3241738 0x38c78c0 INFO DSL src/DslTrackerBintr.cpp:66:TrackerBintr: : gpu-id : 0
0:00:00.049784463 3241738 0x38c78c0 INFO DSL src/DslTrackerBintr.cpp:67:TrackerBintr: : enable-batch-process : 4294967294
0:00:00.049786696 3241738 0x38c78c0 INFO DSL src/DslTrackerBintr.cpp:68:TrackerBintr: : enable-past-frame : 0
0:00:00.049831754 3241738 0x38c78c0 INFO DSL src/DslServicesTracker.cpp:64:TrackerNew: : New Tracker 'iou-tracker' created successfully
0:00:00.050084781 3241738 0x38c78c0 INFO DSL src/DslTilerBintr.cpp:61:TilerBintr: :
0:00:00.050089144 3241738 0x38c78c0 INFO DSL src/DslTilerBintr.cpp:62:TilerBintr: : Initial property values for TilerBintr 'tiler'
0:00:00.050091802 3241738 0x38c78c0 INFO DSL src/DslTilerBintr.cpp:63:TilerBintr: : rows : 0
0:00:00.050094091 3241738 0x38c78c0 INFO DSL src/DslTilerBintr.cpp:64:TilerBintr: : columns : 0
0:00:00.050096315 3241738 0x38c78c0 INFO DSL src/DslTilerBintr.cpp:65:TilerBintr: : width : 1920
0:00:00.050098476 3241738 0x38c78c0 INFO DSL src/DslTilerBintr.cpp:66:TilerBintr: : height : 720
0:00:00.050100747 3241738 0x38c78c0 INFO DSL src/DslTilerBintr.cpp:67:TilerBintr: : show-source : -1
0:00:00.050102939 3241738 0x38c78c0 INFO DSL src/DslTilerBintr.cpp:68:TilerBintr: : gpu-id : 0
0:00:00.050105090 3241738 0x38c78c0 INFO DSL src/DslTilerBintr.cpp:69:TilerBintr: : nvbuf-memory-type : 0
0:00:00.050107218 3241738 0x38c78c0 INFO DSL src/DslTilerBintr.cpp:70:TilerBintr: : compute-hw : 0
0:00:00.050153869 3241738 0x38c78c0 INFO DSL src/DslServicesTiler.cpp:49:TilerNew: : New Tiler 'tiler' created successfully
0:00:00.051794791 3241738 0x38c78c0 INFO DSL src/DslOsdBintr.cpp:80:OsdBintr: :
0:00:00.051801718 3241738 0x38c78c0 INFO DSL src/DslOsdBintr.cpp:81:OsdBintr: : Initial property values for OsdBintr 'on-screen-display'
0:00:00.051804482 3241738 0x38c78c0 INFO DSL src/DslOsdBintr.cpp:82:OsdBintr: : display-bbox : 1
0:00:00.051806752 3241738 0x38c78c0 INFO DSL src/DslOsdBintr.cpp:83:OsdBintr: : display-text : 1
0:00:00.051808942 3241738 0x38c78c0 INFO DSL src/DslOsdBintr.cpp:84:OsdBintr: : display-mask : 0
0:00:00.051811075 3241738 0x38c78c0 INFO DSL src/DslOsdBintr.cpp:85:OsdBintr: : display-clock : 1
0:00:00.051813272 3241738 0x38c78c0 INFO DSL src/DslOsdBintr.cpp:86:OsdBintr: : clock-font : Serif
0:00:00.051815544 3241738 0x38c78c0 INFO DSL src/DslOsdBintr.cpp:87:OsdBintr: : clock-font-size : 12
0:00:00.051817684 3241738 0x38c78c0 INFO DSL src/DslOsdBintr.cpp:88:OsdBintr: : clock-color : 0
0:00:00.051819872 3241738 0x38c78c0 INFO DSL src/DslOsdBintr.cpp:89:OsdBintr: : clock-x-offset : 20
0:00:00.051822021 3241738 0x38c78c0 INFO DSL src/DslOsdBintr.cpp:90:OsdBintr: : clock-y-offset : 20
0:00:00.051824143 3241738 0x38c78c0 INFO DSL src/DslOsdBintr.cpp:91:OsdBintr: : process-mode : 0
0:00:00.051826238 3241738 0x38c78c0 INFO DSL src/DslOsdBintr.cpp:92:OsdBintr: : gpu-id : 0
0:00:00.051828339 3241738 0x38c78c0 INFO DSL src/DslOsdBintr.cpp:93:OsdBintr: : nvbuf-memory-type : 0
0:00:00.051891009 3241738 0x38c78c0 INFO DSL src/DslServicesOsd.cpp:51:OsdNew: : New OSD 'on-screen-display' created successfully
0:00:00.052058931 3241738 0x38c78c0 INFO DSL src/DslServicesPph.cpp:49:PphCustomNew: : New Custom Pad Probe Handler 'custom-pph' created successfully
0:00:00.052091878 3241738 0x38c78c0 INFO DSL src/DslServicesOsd.cpp:569:OsdPphAdd: : OSD 'on-screen-display' added Pad Probe Handler successfully
0:00:00.052918194 3241738 0x38c78c0 INFO DSL src/DslSinkBintr.cpp:810:WindowSinkBintr: :
0:00:00.052925673 3241738 0x38c78c0 INFO DSL src/DslSinkBintr.cpp:811:WindowSinkBintr: : Initial property values for WindowSinkBintr 'window-sink'
0:00:00.052928709 3241738 0x38c78c0 INFO DSL src/DslSinkBintr.cpp:812:WindowSinkBintr: : offset-x : 0
0:00:00.052931067 3241738 0x38c78c0 INFO DSL src/DslSinkBintr.cpp:813:WindowSinkBintr: : offset-y : 0
0:00:00.052933254 3241738 0x38c78c0 INFO DSL src/DslSinkBintr.cpp:814:WindowSinkBintr: : width : 1280
0:00:00.052935475 3241738 0x38c78c0 INFO DSL src/DslSinkBintr.cpp:815:WindowSinkBintr: : height : 720
0:00:00.052937983 3241738 0x38c78c0 INFO DSL src/DslSinkBintr.cpp:816:WindowSinkBintr: : force-aspect-ratio : 0
0:00:00.052940188 3241738 0x38c78c0 INFO DSL src/DslSinkBintr.cpp:817:WindowSinkBintr: : sync : 1
0:00:00.052942314 3241738 0x38c78c0 INFO DSL src/DslSinkBintr.cpp:818:WindowSinkBintr: : async : 1
0:00:00.052944609 3241738 0x38c78c0 INFO DSL src/DslSinkBintr.cpp:819:WindowSinkBintr: : max-lateness : 5000000
0:00:00.052946772 3241738 0x38c78c0 INFO DSL src/DslSinkBintr.cpp:820:WindowSinkBintr: : qos : 1
0:00:00.052948947 3241738 0x38c78c0 INFO DSL src/DslSinkBintr.cpp:821:WindowSinkBintr: : enable-last-sample : 0
0:00:00.052969452 3241738 0x38c78c0 INFO DSL src/DslServicesSink.cpp:267:SinkWindowNew: : New Window Sink 'window-sink' created successfully
0:00:00.053006900 3241738 0x38c78c0 INFO DSL src/DslServicesSink.cpp:524:SinkWindowKeyEventHandlerAdd: : Window Sink 'window-sink' added Key Event Handler successfully
0:00:00.053024121 3241738 0x38c78c0 INFO DSL src/DslServicesSink.cpp:660:SinkWindowDeleteEventHandlerAdd: : Window Sink 'window-sink' added Delete Event Handler successfully
0:00:00.053524073 3241738 0x38c78c0 INFO DSL src/DslPipelineSourcesBintr.cpp:71:PipelineSourcesBintr: :
0:00:00.053529104 3241738 0x38c78c0 INFO DSL src/DslPipelineSourcesBintr.cpp:72:PipelineSourcesBintr: : Initial property values for Streammux 'pipeline-sources-bin'
0:00:00.053531778 3241738 0x38c78c0 INFO DSL src/DslPipelineSourcesBintr.cpp:73:PipelineSourcesBintr: : width : 1920
0:00:00.053534033 3241738 0x38c78c0 INFO DSL src/DslPipelineSourcesBintr.cpp:74:PipelineSourcesBintr: : height : 1080
0:00:00.053536226 3241738 0x38c78c0 INFO DSL src/DslPipelineSourcesBintr.cpp:75:PipelineSourcesBintr: : batched-push-timeout : -1
0:00:00.053538465 3241738 0x38c78c0 INFO DSL src/DslPipelineSourcesBintr.cpp:76:PipelineSourcesBintr: : enable-padding : 0
0:00:00.053540694 3241738 0x38c78c0 INFO DSL src/DslPipelineSourcesBintr.cpp:77:PipelineSourcesBintr: : gpu-id : 0
0:00:00.053542922 3241738 0x38c78c0 INFO DSL src/DslPipelineSourcesBintr.cpp:78:PipelineSourcesBintr: : nvbuf-memory-type : 2
0:00:00.053545170 3241738 0x38c78c0 INFO DSL src/DslPipelineSourcesBintr.cpp:79:PipelineSourcesBintr: : num-surfaces-per-frame : 1
0:00:00.053547405 3241738 0x38c78c0 INFO DSL src/DslPipelineSourcesBintr.cpp:80:PipelineSourcesBintr: : buffer-pool-size : 4
0:00:00.053549607 3241738 0x38c78c0 INFO DSL src/DslPipelineSourcesBintr.cpp:81:PipelineSourcesBintr: : attach-sys-ts : 1
0:00:00.053551826 3241738 0x38c78c0 INFO DSL src/DslPipelineSourcesBintr.cpp:82:PipelineSourcesBintr: : interpolation-method : 1
0:00:00.053553978 3241738 0x38c78c0 INFO DSL src/DslPipelineSourcesBintr.cpp:83:PipelineSourcesBintr: : sync-inputs : 0
0:00:00.053593651 3241738 0x38c78c0 INFO DSL src/DslServicesPipeline.cpp:47:PipelineNew: : New PIPELINE 'pipeline' created successfully
0:00:00.053611248 3241738 0x38c78c0 INFO DSL src/DslPipelineSourcesBintr.cpp:410:StreammuxPlayTypeIsLiveSet: : 'live-source' attrubute set to '0' for Streammuxer 'pipeline-sources-bin'
0:00:00.053650181 3241738 0x38c78c0 INFO DSL src/DslServicesPipeline.cpp:140:PipelineComponentAdd: : Component 'uri-h264' was added to Pipeline 'pipeline' successfully
0:00:00.053677654 3241738 0x38c78c0 INFO DSL src/DslServicesPipeline.cpp:140:PipelineComponentAdd: : Component 'uri-h265' was added to Pipeline 'pipeline' successfully
0:00:00.053688026 3241738 0x38c78c0 INFO DSL src/DslBranchBintr.cpp:114:AddPrimaryInferBintr: : Adding PrimaryInferBintr 'pgie' to Pipeline/Branch 'pipeline'
0:00:00.053707218 3241738 0x38c78c0 INFO DSL src/DslServicesPipeline.cpp:140:PipelineComponentAdd: : Component 'pgie' was added to Pipeline 'pipeline' successfully
0:00:00.053722002 3241738 0x38c78c0 INFO DSL src/DslServicesPipeline.cpp:140:PipelineComponentAdd: : Component 'iou-tracker' was added to Pipeline 'pipeline' successfully
0:00:00.053849750 3241738 0x38c78c0 INFO DSL src/DslServicesPipeline.cpp:140:PipelineComponentAdd: : Component 'carcolor-sgie' was added to Pipeline 'pipeline' successfully
0:00:00.053898504 3241738 0x38c78c0 INFO DSL src/DslServicesPipeline.cpp:140:PipelineComponentAdd: : Component 'carmake-sgie' was added to Pipeline 'pipeline' successfully
0:00:00.053948508 3241738 0x38c78c0 INFO DSL src/DslServicesPipeline.cpp:140:PipelineComponentAdd: : Component 'vehicletype-sgie' was added to Pipeline 'pipeline' successfully
0:00:00.053963406 3241738 0x38c78c0 INFO DSL src/DslServicesPipeline.cpp:140:PipelineComponentAdd: : Component 'tiler' was added to Pipeline 'pipeline' successfully
0:00:00.053979393 3241738 0x38c78c0 INFO DSL src/DslServicesPipeline.cpp:140:PipelineComponentAdd: : Component 'on-screen-display' was added to Pipeline 'pipeline' successfully
0:00:00.054035964 3241738 0x38c78c0 INFO DSL src/DslMultiBranchesBintr.cpp:398:MultiSinksBintr: :
0:00:00.054038616 3241738 0x38c78c0 INFO DSL src/DslMultiBranchesBintr.cpp:399:MultiSinksBintr: : Initial property values for MultiSinksBintr 'sinks-bin'
0:00:00.054041089 3241738 0x38c78c0 INFO DSL src/DslMultiBranchesBintr.cpp:400:MultiSinksBintr: : blocking-timeout : 1
0:00:00.054071559 3241738 0x38c78c0 INFO DSL src/DslServicesPipeline.cpp:140:PipelineComponentAdd: : Component 'window-sink' was added to Pipeline 'pipeline' successfully
0:00:00.054100876 3241738 0x38c78c0 INFO DSL src/DslServicesPipeline.cpp:812:PipelineStateChangeListenerAdd: : Pipeline 'pipeline' added State Change Listener successfully
0:00:00.054113588 3241738 0x38c78c0 INFO DSL src/DslServicesPipeline.cpp:870:PipelineEosListenerAdd: : Pipeline 'pipeline' added End of Stream Listener successfully
0:00:00.054141351 3241738 0x38c78c0 INFO DSL src/DslNodetr.h:599:LinkToSinkMuxer: : Linking requested Sink Pad'0x4830c50' for GstNodetr 'uri-h264'
0:00:00.054177665 3241738 0x38c78c0 INFO DSL src/DslNodetr.h:599:LinkToSinkMuxer: : Linking requested Sink Pad'0x4830ea0' for GstNodetr 'uri-h265'
0:00:00.054196861 3241738 0x38c78c0 INFO DSL src/DslPipelineBintr.cpp:261:LinkAll: : Pipeline 'pipeline' Linked up all Source 'pipeline-sources-bin' successfully
0:00:00.054206662 3241738 0x38c78c0 INFO DSL src/DslBintr.h:199:SetBatchSize: : Setting batch size to '2' for Bintr 'pgie'
0:00:00.054334935 3241738 0x38c78c0 INFO DSL src/DslBranchBintr.cpp:454:LinkAll: : Branch 'pipeline' Linked up PrimaryInferBintr 'pgie' successfully
0:00:00.054398562 3241738 0x38c78c0 INFO DSL src/DslBranchBintr.cpp:470:LinkAll: : Branch 'pipeline' Linked up Tracker 'iou-tracker' successfully
0:00:00.054401979 3241738 0x38c78c0 INFO DSL src/DslBintr.h:199:SetBatchSize: : Setting batch size to '2' for Bintr 'secondary-infer-bin'
0:00:00.054428323 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:687:SetInferOnAttributes: : Setting infer-on-id for SecondaryInferBintr 'carcolor-sgie' to 1
0:00:00.054437053 3241738 0x38c78c0 INFO DSL src/DslBintr.h:199:SetBatchSize: : Setting batch size to '2' for Bintr 'carcolor-sgie'
0:00:00.054440919 3241738 0x38c78c0 INFO DSL src/DslPipelineSInfersBintr.cpp:219:LinkAll: : Linking 'carcolor-sgie' back to src tee'secondary-infer-bin-tee'
0:00:00.054471445 3241738 0x38c78c0 INFO DSL src/DslNodetr.h:752:LinkToSourceTee: : Linking requested source pad'0x481cc60' for GstNodetr 'carcolor-sgie-queue-fakesink'
0:00:00.054495680 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:699:LinkToSource: : Linking SecondaryInferBintr 'carcolor-sgie' to Tee 'secondary-infer-bin-tee'
0:00:00.054518037 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:687:SetInferOnAttributes: : Setting infer-on-id for SecondaryInferBintr 'carmake-sgie' to 1
0:00:00.054526214 3241738 0x38c78c0 INFO DSL src/DslBintr.h:199:SetBatchSize: : Setting batch size to '2' for Bintr 'carmake-sgie'
0:00:00.054529499 3241738 0x38c78c0 INFO DSL src/DslPipelineSInfersBintr.cpp:219:LinkAll: : Linking 'carmake-sgie' back to src tee'secondary-infer-bin-tee'
0:00:00.054557544 3241738 0x38c78c0 INFO DSL src/DslNodetr.h:752:LinkToSourceTee: : Linking requested source pad'0x481d120' for GstNodetr 'carmake-sgie-queue-fakesink'
0:00:00.054579561 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:699:LinkToSource: : Linking SecondaryInferBintr 'carmake-sgie' to Tee 'secondary-infer-bin-tee'
0:00:00.054601816 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:687:SetInferOnAttributes: : Setting infer-on-id for SecondaryInferBintr 'vehicletype-sgie' to 1
0:00:00.054609795 3241738 0x38c78c0 INFO DSL src/DslBintr.h:199:SetBatchSize: : Setting batch size to '2' for Bintr 'vehicletype-sgie'
0:00:00.054613281 3241738 0x38c78c0 INFO DSL src/DslPipelineSInfersBintr.cpp:219:LinkAll: : Linking 'vehicletype-sgie' back to src tee'secondary-infer-bin-tee'
0:00:00.054640790 3241738 0x38c78c0 INFO DSL src/DslNodetr.h:752:LinkToSourceTee: : Linking requested source pad'0x481d5e0' for GstNodetr 'vehicletype-sgie-queue-fakesink'
0:00:00.054663156 3241738 0x38c78c0 INFO DSL src/DslInferBintr.cpp:699:LinkToSource: : Linking SecondaryInferBintr 'vehicletype-sgie' to Tee 'secondary-infer-bin-tee'
0:00:00.054774728 3241738 0x38c78c0 INFO DSL src/DslBranchBintr.cpp:486:LinkAll: : Branch 'pipeline' Linked up all Secondary GIEs 'secondary-infer-bin' successfully
0:00:00.054778459 3241738 0x38c78c0 INFO DSL src/DslBintr.h:199:SetBatchSize: : Setting batch size to '2' for Bintr 'tiler'
0:00:00.054872658 3241738 0x38c78c0 INFO DSL src/DslBranchBintr.cpp:532:LinkAll: : Branch 'pipeline' Linked up Tiler 'tiler' successfully
0:00:00.054876258 3241738 0x38c78c0 INFO DSL src/DslBintr.h:199:SetBatchSize: : Setting batch size to '2' for Bintr 'on-screen-display'
0:00:00.055082958 3241738 0x38c78c0 INFO DSL src/DslBranchBintr.cpp:548:LinkAll: : Branch 'pipeline' Linked up OSD 'on-screen-display' successfully
0:00:00.055088334 3241738 0x38c78c0 INFO DSL src/DslBintr.h:199:SetBatchSize: : Setting batch size to '2' for Bintr 'window-sink'
0:00:00.055091502 3241738 0x38c78c0 INFO DSL src/DslBintr.h:199:SetBatchSize: : Setting batch size to '2' for Bintr 'sinks-bin'
0:00:00.055108580 3241738 0x38c78c0 INFO DSL src/DslServicesSink.cpp:208:_sinkWindowRegister: : Registering Window-Sink 'window-sink' with GstObject = 0x4822620
0:00:00.055233337 3241738 0x38c78c0 INFO DSL src/DslNodetr.h:752:LinkToSourceTee: : Linking requested source pad'0x481daa0' for GstNodetr 'window-sink'
0:00:00.055421911 3241738 0x38c78c0 INFO DSL src/DslBranchBintr.cpp:600:LinkAll: : Branch 'pipeline' Linked up all Sinks 'sinks-bin' successfully
0:00:00.055426742 3241738 0x38c78c0 INFO DSL src/DslNodetr.h:915:SetState: : Changing state to 'PAUSED' for GstNodetr 'pipeline'
0:00:00.182910906 3241738 0x38c78c0 INFO DSL src/DslServicesSink.cpp:241:_sinkWindowGet: : Returning Window-Sink 'window-sink'
0:00:00.183322401 3241738 0x38c78c0 INFO DSL src/DslSinkBintr.cpp:1257:CreateXWindow: : Creating new XWindow: x-offset = 0, y-offset = 0, width = 1280, height = 720 for WindowSinkBintr 'window-sink'
WARNING: [TRT]: CUDA lazy loading is not enabled. Enabling it can significantly reduce device memory usage. See CUDA_MODULE_LOADING in https://docs.nvidia.com/cuda/cuda-c-programming-guide/index.html#env-vars
WARNING: [TRT]: CUDA lazy loading is not enabled. Enabling it can significantly reduce device memory usage. See CUDA_MODULE_LOADING in https://docs.nvidia.com/cuda/cuda-c-programming-guide/index.html#env-vars
0:00:01.779088043 3241738 0x38c78c0 INFO nvinfer gstnvinfer.cpp:682:gst_nvinfer_logger: NvDsInferContext[UID 4]: Info from NvDsInferContextImpl::deserializeEngineAndBackend()
0:00:01.830341013 3241738 0x38c78c0 INFO nvinfer gstnvinfer.cpp:682:gst_nvinfer_logger: NvDsInferContext[UID 4]: Info from NvDsInferContextImpl::generateBackendContext()
0:00:03.109508305 3241738 0x38c78c0 INFO nvinfer gstnvinfer.cpp:682:gst_nvinfer_logger: NvDsInferContext[UID 3]: Info from NvDsInferContextImpl::generateBackendContext()
0:00:04.379362501 3241738 0x38c78c0 INFO nvinfer gstnvinfer.cpp:682:gst_nvinfer_logger: NvDsInferContext[UID 2]: Info from NvDsInferContextImpl::generateBackendContext()
0:00:05.681984210 3241738 0x38c78c0 INFO nvinfer gstnvinfer.cpp:682:gst_nvinfer_logger: NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::generateBackendContext()
> The code gets stuck every time it runs here.
@MintyLee Thank you... I can actually reproduce this. I will let you know when it's fixed
@MintyLee Thank you... I can actually reproduce this. I will let you know when it's fixed Has this problem been located?
@MintyLee issue #1086 was opened for this, which has the explanation for failure if you're interested... along with issue #1090 .
Both have been closed with a new patch - version v0.27.a.alpha
- released today. Please upgrade to the latest... and my apologies for how long this took to resolve.
I add a secondary infer gie in the example ode_cross_polygon_border_print_event.cpp, but after that the program stucked logs: