sherlockchou86 / VideoPipe

跨平台的视频结构化(视频分析)框架,觉得有帮助的请给个星星 : ) 。**VideoPipe下一版本正在开发中,在保证跨平台、易上手的前提下,预计性能直逼deepstream等各硬件平台官方框架**。
Apache License 2.0
1.16k stars 165 forks source link

1-1-1_sample 异常 #53

Closed GDbbq closed 3 weeks ago

GDbbq commented 3 weeks ago

image

./bin/1-1-1_sample 
[2024-06-07 10:53:27.836][Info ] [file_src_0] [filesrc location=./vp_data/test_video/face.mp4 ! qtdemux ! h264parse ! avdec_h264 ! videoconvert ! appsink]
[2024-06-07 10:53:28.001][Info ] [screen_des_0] [appsrc ! videoconvert ! videoscale ! textoverlay text=screen_des_0 halignment=left valignment=top font-desc='Sans,16' shaded-background=true ! timeoverlay halignment=right valignment=top font-desc='Sans,16' shaded-background=true ! queue ! fpsdisplaysink video-sink=ximagesink sync=false]
[2024-06-07 10:53:28.002][Info ] 
############# pipe check summary ##############
 total layers: 5
 layer index,       node names
 1                    file_src_0,
 2                    yunet_face_detector_0,
 3                    sface_face_encoder_0,
 4                    osd_0,
 5                    screen_des_0,
############# pipe check summary ##############

[ WARN:0@0.377] global cap_gstreamer.cpp:1697 open OpenCV | GStreamer warning: unable to query duration of stream
[ WARN:0@0.377] global cap_gstreamer.cpp:1728 open OpenCV | GStreamer warning: Cannot query video position: status=1, value=0, duration=-1
[2024-06-07 10:53:28.194][Debug] [file_src_0] before dispatching meta, out_queue.size()==>1
[2024-06-07 10:53:28.194][Debug] [file_src_0] after handling meta, out_queue.size()==>1
[2024-06-07 10:53:28.195][Debug] [yunet_face_detector_0] before meta flow, in_queue.size()==>0
[2024-06-07 10:53:28.195][Debug] [yunet_face_detector_0] after meta flow, in_queue.size()==>1
[2024-06-07 10:53:28.196][Debug] [file_src_0] after dispatching meta, out_queue.size()==>0
[2024-06-07 10:53:28.195][Debug] [yunet_face_detector_0] before handling meta, in_queue.size()==>1
[2024-06-07 10:53:28.231][Debug] [file_src_0] before dispatching meta, out_queue.size()==>1
[2024-06-07 10:53:28.231][Debug] [file_src_0] after handling meta, out_queue.size()==>1
[2024-06-07 10:53:28.231][Debug] [yunet_face_detector_0] before meta flow, in_queue.size()==>1
[2024-06-07 10:53:28.231][Debug] [yunet_face_detector_0] after meta flow, in_queue.size()==>2
[2024-06-07 10:53:28.231][Debug] [file_src_0] after dispatching meta, out_queue.size()==>0
[2024-06-07 10:53:28.246][Debug] 
########## infer combinations summary ##########
 node_name:yunet_face_detector_0
 data_size:1
 prepare_time:0ms
 preprocess_time:8ms
 infer_time:31ms
 postprocess_time:8ms
########## infer combinations summary ##########

[2024-06-07 10:53:28.246][Debug] [yunet_face_detector_0] after handling meta, in_queue.size()==>1
[2024-06-07 10:53:28.246][Debug] [yunet_face_detector_0] before handling meta, out_queue.size()==>0
[2024-06-07 10:53:28.246][Debug] [yunet_face_detector_0] after handling meta, out_queue.size()==>1
[2024-06-07 10:53:28.246][Debug] [yunet_face_detector_0] before handling meta, in_queue.size()==>1
[2024-06-07 10:53:28.246][Debug] [yunet_face_detector_0] before dispatching meta, out_queue.size()==>1
[2024-06-07 10:53:28.247][Debug] [sface_face_encoder_0] before meta flow, in_queue.size()==>0
[2024-06-07 10:53:28.247][Debug] [sface_face_encoder_0] before handling meta, in_queue.size()==>1
[2024-06-07 10:53:28.247][Debug] [sface_face_encoder_0] after meta flow, in_queue.size()==>1
[2024-06-07 10:53:28.247][Debug] [yunet_face_detector_0] after dispatching meta, out_queue.size()==>0
[2024-06-07 10:53:28.267][Debug] 
########## infer combinations summary ##########
 node_name:yunet_face_detector_0
 data_size:1
 prepare_time:0ms
 preprocess_time:1ms
 infer_time:13ms
 postprocess_time:6ms
########## infer combinations summary ##########

[2024-06-07 10:53:28.268][Debug] [yunet_face_detector_0] after handling meta, in_queue.size()==>0
[2024-06-07 10:53:28.268][Debug] [yunet_face_detector_0] before handling meta, out_queue.size()==>0
[2024-06-07 10:53:28.268][Debug] [yunet_face_detector_0] after handling meta, out_queue.size()==>1
[2024-06-07 10:53:28.268][Debug] [yunet_face_detector_0] before dispatching meta, out_queue.size()==>1
[2024-06-07 10:53:28.268][Debug] [sface_face_encoder_0] before meta flow, in_queue.size()==>1
[2024-06-07 10:53:28.269][Debug] [sface_face_encoder_0] after meta flow, in_queue.size()==>2
[2024-06-07 10:53:28.269][Debug] [yunet_face_detector_0] after dispatching meta, out_queue.size()==>0
[2024-06-07 10:53:28.269][Debug] [file_src_0] before dispatching meta, out_queue.size()==>1
[2024-06-07 10:53:28.269][Debug] [file_src_0] after handling meta, out_queue.size()==>1
[2024-06-07 10:53:28.269][Debug] [yunet_face_detector_0] before meta flow, in_queue.size()==>0
[2024-06-07 10:53:28.270][Debug] [yunet_face_detector_0] after meta flow, in_queue.size()==>1
[2024-06-07 10:53:28.270][Debug] [yunet_face_detector_0] before handling meta, in_queue.size()==>1
[2024-06-07 10:53:28.270][Debug] [file_src_0] after dispatching meta, out_queue.size()==>0
[2024-06-07 10:53:28.300][Debug] 
########## infer combinations summary ##########
 node_name:yunet_face_detector_0
 data_size:1
 prepare_time:0ms
 preprocess_time:1ms
 infer_time:17ms
 postprocess_time:10ms
########## infer combinations summary ##########

[2024-06-07 10:53:28.300][Debug] [yunet_face_detector_0] after handling meta, in_queue.size()==>0
[2024-06-07 10:53:28.300][Debug] [yunet_face_detector_0] before handling meta, out_queue.size()==>0
[2024-06-07 10:53:28.300][Debug] [yunet_face_detector_0] after handling meta, out_queue.size()==>1
[2024-06-07 10:53:28.300][Debug] [yunet_face_detector_0] before dispatching meta, out_queue.size()==>1
[2024-06-07 10:53:28.301][Debug] [sface_face_encoder_0] before meta flow, in_queue.size()==>2
[2024-06-07 10:53:28.301][Debug] [sface_face_encoder_0] after meta flow, in_queue.size()==>3
[2024-06-07 10:53:28.301][Debug] [yunet_face_detector_0] after dispatching meta, out_queue.size()==>0
[2024-06-07 10:53:28.303][Debug] 
########## infer combinations summary ##########
 node_name:sface_face_encoder_0
 data_size:1
 prepare_time:0ms
 preprocess_time:0ms
 infer_time:54ms
 postprocess_time:0ms
########## infer combinations summary ##########
[2024-06-07 10:53:28.303][Debug] [sface_face_encoder_0] after handling meta, in_queue.size()==>2
[2024-06-07 10:53:28.303][Debug] [sface_face_encoder_0] before handling meta, out_queue.size()==>0
[2024-06-07 10:53:28.303][Debug] [sface_face_encoder_0] after handling meta, out_queue.size()==>1
[2024-06-07 10:53:28.303][Debug] [sface_face_encoder_0] before dispatching meta, out_queue.size()==>1
[2024-06-07 10:53:28.304][Debug] [sface_face_encoder_0] before handling meta, in_queue.size()==>2
[2024-06-07 10:53:28.304][Debug] [osd_0] before meta flow, in_queue.size()==>0
[2024-06-07 10:53:28.304][Debug] [osd_0] after meta flow, in_queue.size()==>1
[2024-06-07 10:53:28.304][Debug] [osd_0] before handling meta, in_queue.size()==>1
[2024-06-07 10:53:28.304][Debug] [sface_face_encoder_0] after dispatching meta, out_queue.size()==>0
[2024-06-07 10:53:28.306][Debug] [osd_0] after handling meta, in_queue.size()==>0
[2024-06-07 10:53:28.306][Debug] [osd_0] before handling meta, out_queue.size()==>0
[2024-06-07 10:53:28.306][Debug] [osd_0] after handling meta, out_queue.size()==>1
[2024-06-07 10:53:28.306][Debug] [osd_0] before dispatching meta, out_queue.size()==>1
[2024-06-07 10:53:28.306][Debug] [screen_des_0] before meta flow, in_queue.size()==>0
[2024-06-07 10:53:28.307][Debug] [screen_des_0] after meta flow, in_queue.size()==>1
[2024-06-07 10:53:28.307][Debug] [osd_0] after dispatching meta, out_queue.size()==>0
[2024-06-07 10:53:28.308][Debug] [screen_des_0] before handling meta, in_queue.size()==>1
[2024-06-07 10:53:28.308][Debug] [screen_des_0] received frame meta, channel_index=>0, frame_index=>0
[2024-06-07 10:53:28.311][Debug] [file_src_0] after handling meta, out_queue.size()==>1
[2024-06-07 10:53:28.311][Debug] [file_src_0] before dispatching meta, out_queue.size()==>1
[2024-06-07 10:53:28.311][Debug] [yunet_face_detector_0] before meta flow, in_queue.size()==>0
[2024-06-07 10:53:28.312][Debug] [yunet_face_detector_0] after meta flow, in_queue.size()==>1
[2024-06-07 10:53:28.312][Debug] [yunet_face_detector_0] before handling meta, in_queue.size()==>1
[2024-06-07 10:53:28.312][Debug] [file_src_0] after dispatching meta, out_queue.size()==>0
[2024-06-07 10:53:28.313][Debug] 
########## infer combinations summary ##########
 node_name:sface_face_encoder_0
 data_size:1
 prepare_time:0ms
 preprocess_time:0ms
 infer_time:8ms
 postprocess_time:0ms
########## infer combinations summary ##########

[2024-06-07 10:53:28.313][Debug] [sface_face_encoder_0] after handling meta, in_queue.size()==>1
[2024-06-07 10:53:28.313][Debug] [sface_face_encoder_0] before handling meta, out_queue.size()==>0
[2024-06-07 10:53:28.313][Debug] [sface_face_encoder_0] after handling meta, out_queue.size()==>1
[2024-06-07 10:53:28.313][Debug] [sface_face_encoder_0] before dispatching meta, out_queue.size()==>1
[2024-06-07 10:53:28.313][Debug] [sface_face_encoder_0] before handling meta, in_queue.size()==>1
[2024-06-07 10:53:28.314][Debug] [osd_0] before meta flow, in_queue.size()==>0
[2024-06-07 10:53:28.314][Debug] [osd_0] after meta flow, in_queue.size()==>1
[2024-06-07 10:53:28.314][Debug] [osd_0] before handling meta, in_queue.size()==>1
[2024-06-07 10:53:28.314][Debug] [sface_face_encoder_0] after dispatching meta, out_queue.size()==>0
[2024-06-07 10:53:28.315][Debug] [osd_0] after handling meta, in_queue.size()==>0
[2024-06-07 10:53:28.316][Debug] [osd_0] before handling meta, out_queue.size()==>0
[2024-06-07 10:53:28.316][Debug] [osd_0] after handling meta, out_queue.size()==>1
[2024-06-07 10:53:28.316][Debug] [osd_0] before dispatching meta, out_queue.size()==>1
[2024-06-07 10:53:28.316][Debug] [screen_des_0] before meta flow, in_queue.size()==>1
[2024-06-07 10:53:28.317][Debug] [screen_des_0] after meta flow, in_queue.size()==>2
[2024-06-07 10:53:28.317][Debug] [osd_0] after dispatching meta, out_queue.size()==>0
[2024-06-07 10:53:28.321][Debug] 
########## infer combinations summary ##########
 node_name:sface_face_encoder_0
 data_size:1
 prepare_time:0ms
 preprocess_time:0ms
 infer_time:7ms
 postprocess_time:0ms
########## infer combinations summary ##########

[2024-06-07 10:53:28.322][Debug] [sface_face_encoder_0] after handling meta, in_queue.size()==>0
[2024-06-07 10:53:28.322][Debug] [sface_face_encoder_0] before handling meta, out_queue.size()==>0
[2024-06-07 10:53:28.322][Debug] [sface_face_encoder_0] after handling meta, out_queue.size()==>1
[2024-06-07 10:53:28.322][Debug] [sface_face_encoder_0] before dispatching meta, out_queue.size()==>1
[2024-06-07 10:53:28.322][Debug] [osd_0] before meta flow, in_queue.size()==>0
[2024-06-07 10:53:28.323][Debug] [osd_0] after meta flow, in_queue.size()==>1
[2024-06-07 10:53:28.323][Debug] [osd_0] before handling meta, in_queue.size()==>1
[2024-06-07 10:53:28.323][Debug] [sface_face_encoder_0] after dispatching meta, out_queue.size()==>0
[2024-06-07 10:53:28.324][Debug] [osd_0] after handling meta, in_queue.size()==>0
[2024-06-07 10:53:28.325][Debug] [osd_0] before handling meta, out_queue.size()==>0
[2024-06-07 10:53:28.325][Debug] [osd_0] after handling meta, out_queue.size()==>1
[2024-06-07 10:53:28.325][Debug] [osd_0] before dispatching meta, out_queue.size()==>1
[2024-06-07 10:53:28.326][Debug] [screen_des_0] before meta flow, in_queue.size()==>2
[2024-06-07 10:53:28.326][Debug] [screen_des_0] after meta flow, in_queue.size()==>3
[2024-06-07 10:53:28.326][Debug] [osd_0] after dispatching meta, out_queue.size()==>0
[2024-06-07 10:53:28.342][Debug] 
########## infer combinations summary ##########
 node_name:yunet_face_detector_0
 data_size:1
 prepare_time:0ms
 preprocess_time:1ms
 infer_time:21ms
 postprocess_time:6ms
########## infer combinations summary ##########

[2024-06-07 10:53:28.342][Debug] [yunet_face_detector_0] after handling meta, in_queue.size()==>0
[2024-06-07 10:53:28.342][Debug] [yunet_face_detector_0] before handling meta, out_queue.size()==>0
[2024-06-07 10:53:28.342][Debug] [yunet_face_detector_0] after handling meta, out_queue.size()==>1
[2024-06-07 10:53:28.343][Debug] [yunet_face_detector_0] before dispatching meta, out_queue.size()==>1
[2024-06-07 10:53:28.343][Debug] [sface_face_encoder_0] before meta flow, in_queue.size()==>0
[2024-06-07 10:53:28.343][Debug] [sface_face_encoder_0] before handling meta, in_queue.size()==>1
[2024-06-07 10:53:28.343][Debug] [sface_face_encoder_0] after meta flow, in_queue.size()==>1
[2024-06-07 10:53:28.343][Debug] [yunet_face_detector_0] after dispatching meta, out_queue.size()==>0
[2024-06-07 10:53:28.352][Debug] [file_src_0] before dispatching meta, out_queue.size()==>1
[2024-06-07 10:53:28.352][Debug] [file_src_0] after handling meta, out_queue.size()==>1
[2024-06-07 10:53:28.353][Debug] [yunet_face_detector_0] before meta flow, in_queue.size()==>0
[2024-06-07 10:53:28.353][Debug] [yunet_face_detector_0] after meta flow, in_queue.size()==>1
[2024-06-07 10:53:28.353][Debug] [yunet_face_detector_0] before handling meta, in_queue.size()==>1
[2024-06-07 10:53:28.353][Debug] [file_src_0] after dispatching meta, out_queue.size()==>0
[2024-06-07 10:53:28.353][Debug] 
########## infer combinations summary ##########
 node_name:sface_face_encoder_0
 data_size:1
 prepare_time:0ms
 preprocess_time:0ms
 infer_time:9ms
 postprocess_time:0ms
########## infer combinations summary ##########

[2024-06-07 10:53:28.353][Debug] [sface_face_encoder_0] after handling meta, in_queue.size()==>0
[2024-06-07 10:53:28.354][Debug] [sface_face_encoder_0] before handling meta, out_queue.size()==>0
[2024-06-07 10:53:28.354][Debug] [sface_face_encoder_0] after handling meta, out_queue.size()==>1
[2024-06-07 10:53:28.354][Debug] [sface_face_encoder_0] before dispatching meta, out_queue.size()==>1
[2024-06-07 10:53:28.355][Debug] [osd_0] before meta flow, in_queue.size()==>0
[2024-06-07 10:53:28.355][Debug] [osd_0] before handling meta, in_queue.size()==>1
[2024-06-07 10:53:28.355][Debug] [osd_0] after meta flow, in_queue.size()==>1
[2024-06-07 10:53:28.356][Debug] [sface_face_encoder_0] after dispatching meta, out_queue.size()==>0
[2024-06-07 10:53:28.357][Debug] [osd_0] after handling meta, in_queue.size()==>0
[2024-06-07 10:53:28.358][Debug] [osd_0] before handling meta, out_queue.size()==>0
[2024-06-07 10:53:28.358][Debug] [osd_0] after handling meta, out_queue.size()==>1
[2024-06-07 10:53:28.358][Debug] [osd_0] before dispatching meta, out_queue.size()==>1
[2024-06-07 10:53:28.359][Debug] [screen_des_0] before meta flow, in_queue.size()==>3
[2024-06-07 10:53:28.359][Debug] [screen_des_0] after meta flow, in_queue.size()==>4
[2024-06-07 10:53:28.359][Debug] [osd_0] after dispatching meta, out_queue.size()==>0
[2024-06-07 10:53:28.373][Debug] 
########## infer combinations summary ##########
 node_name:yunet_face_detector_0
 data_size:1
 prepare_time:0ms
 preprocess_time:1ms
 infer_time:12ms
 postprocess_time:6ms
########## infer combinations summary ##########

[2024-06-07 10:53:28.373][Debug] [yunet_face_detector_0] after handling meta, in_queue.size()==>0
[2024-06-07 10:53:28.373][Debug] [yunet_face_detector_0] before handling meta, out_queue.size()==>0
[2024-06-07 10:53:28.373][Debug] [yunet_face_detector_0] after handling meta, out_queue.size()==>1
[2024-06-07 10:53:28.373][Debug] [yunet_face_detector_0] before dispatching meta, out_queue.size()==>1
[2024-06-07 10:53:28.374][Debug] [sface_face_encoder_0] before meta flow, in_queue.size()==>0
[2024-06-07 10:53:28.374][Debug] [sface_face_encoder_0] after meta flow, in_queue.size()==>1
[2024-06-07 10:53:28.374][Debug] [sface_face_encoder_0] before handling meta, in_queue.size()==>1
[2024-06-07 10:53:28.374][Debug] [yunet_face_detector_0] after dispatching meta, out_queue.size()==>0
[2024-06-07 10:53:28.383][Debug] 
########## infer combinations summary ##########
 node_name:sface_face_encoder_0
 data_size:1
 prepare_time:0ms
 preprocess_time:0ms
 infer_time:8ms
 postprocess_time:0ms
########## infer combinations summary ##########

[2024-06-07 10:53:28.383][Debug] [sface_face_encoder_0] after handling meta, in_queue.size()==>0
[2024-06-07 10:53:28.384][Debug] [sface_face_encoder_0] before handling meta, out_queue.size()==>0
[2024-06-07 10:53:28.384][Debug] [sface_face_encoder_0] after handling meta, out_queue.size()==>1
[2024-06-07 10:53:28.384][Debug] [sface_face_encoder_0] before dispatching meta, out_queue.size()==>1
[2024-06-07 10:53:28.384][Debug] [osd_0] before meta flow, in_queue.size()==>0
[2024-06-07 10:53:28.385][Debug] [osd_0] after meta flow, in_queue.size()==>1
[2024-06-07 10:53:28.385][Debug] [osd_0] before handling meta, in_queue.size()==>1
[2024-06-07 10:53:28.385][Debug] [sface_face_encoder_0] after dispatching meta, out_queue.size()==>0
[2024-06-07 10:53:28.386][Debug] [osd_0] after handling meta, in_queue.size()==>0
[2024-06-07 10:53:28.386][Debug] [osd_0] before handling meta, out_queue.size()==>0
[ WARN:3@0.576] global cap_gstreamer.cpp:2784 handleMessage OpenCV | GStreamer warning: Embedded video playback halted; module ximagesink0 reported: Could not initialise X output
[ WARN:3@0.576] global cap_gstreamer.cpp:2575 open OpenCV | GStreamer warning: GStreamer: cannot put pipeline to play

1-1-1_sample: /home/projects/VideoPipe/nodes/vp_screen_des_node.cpp:36: virtual std::shared_ptr<vp_objects::vp_meta> vp_nodes::vp_screen_des_node::handle_frame_meta(std::shared_ptr<vp_objects::vp_frame_meta>): Assertion `screen_writer.open(this->gst_template, cv::CAP_GSTREAMER, 0, meta->fps, {resize_frame.cols, resize_frame.rows})' failed.
[2024-06-07 10:53:28.387][Debug] [osd_0] after handling meta, out_queue.size()==>1
[2024-06-07 10:53:28.387][Debug] [osd_0] before dispatching meta, out_queue.size()==>1
Aborted (core dumped)