couldn't render frame when calling textoveraly/timeoverlay after tcpclientsrc

stereoboy commented 1 year ago

gst-launch-1.0 -tv tcpclientsrc host=$HOST port=5000 ! jpegdec ! textoverlay text="remote" ! autovideosink

0:00:04.100412697   244 0x5583b3201640 WARN         basetextoverlay gstbasetextoverlay.c:3012:gst_base_text_overlay_video_chain:<fps-display-text-overlay> buffer without timestamp, discarding

https://github.com/GStreamer/gst-plugins-base/blob/master/ext/pango/gstbasetextoverlay.c#L2740

  if (!GST_BUFFER_TIMESTAMP_IS_VALID (buffer))
    goto missing_timestamp;

should know the meaning of GST_BUFFER_TIMESTAMP_IS_VALID

stereoboy commented 1 year ago

when calling videorate... there are 2 caeses

without rtpstreampay/rtpstreamdepay

with tcpclientsrc host=127.0.0.1 port=5000 do-timestamp=true


GST_DEBUG=2 sh ./tcp_streaming_jpeg_receiver.sh

HOST=127.0.0.1
gst-launch-1.0 -tv tcpclientsrc host=127.0.0.1 port=5000 do-timestamp=true ! jpegdec ! videorate ! autovideosink
Setting pipeline to PAUSED ...
0:00:00.064180626 569 0x564ae4587d00 WARN xcontext xvcontext.c:538:gst_xvcontext_check_xshm_calls: MIT-SHM extension check failed at XShmAttach. Not using shared memory.
0:00:00.065953434 569 0x564ae4587d00 WARN xcontext xvcontext.c:538:gst_xvcontext_check_xshm_calls: MIT-SHM extension check failed at XShmAttach. Not using shared memory.
Pipeline is PREROLLING ...
/GstPipeline:pipeline0/GstJpegDec:jpegdec0.GstPad:src: caps = video/x-raw, format=(string)I420, width=(int)1280, height=(int)720, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-fl ipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, chroma-site=(string)jpeg, colorimetry=(string)1:4:0:0, framerate=(fraction)0/1
/GstPipeline:pipeline0/GstVideoRate:videorate0.GstPad:src: caps = video/x-raw, format=(string)I420, width=(int)1280, height=(int)720, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/lef t-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, chroma-site=(string)jpeg, colorimetry=(string)1:4:0:0, framerate=(fraction)0/1
/GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0.GstGhostPad:sink.GstProxyPad:proxypad0: caps = video/x-raw, format=(string)I420, width=(int)1280, height=(int)720, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlags Set)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, chroma-site=(string)jpeg, colorimetry=(string)1:4:0:0, framerate=(fraction)0/1
/GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstXvImageSink:autovideosink0-actual-sink-xvimage.GstPad:sink: caps = video/x-raw, format=(string)I420, width=(int)1280, height=(int)720, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags= (GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, chroma-site=(string)jpeg, colorimetry=(string)1:4:0:0, framerate=(fraction)0/1
/GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0.GstGhostPad:sink: caps = video/x-raw, format=(string)I420, width=(int)1280, height=(int)720, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right- view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, chroma-site=(string)jpeg, colorimetry=(string)1:4:0:0, framerate=(fraction)0/1
/GstPipeline:pipeline0/GstVideoRate:videorate0.GstPad:sink: caps = video/x-raw, format=(string)I420, width=(int)1280, height=(int)720, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/le ft-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, chroma-site=(string)jpeg, colorimetry=(string)1:4:0:0, framerate=(fraction)0/1
0:00:00.085315991 569 0x564ae45725e0 WARN videorate gstvideorate.c:1789:gst_video_rate_transform_ip:
Got buffer with GST_CLOCK_TIME_NONE timestamp, discarding it
0:00:00.085372432 569 0x564ae45725e0 WARN videodecoder gstvideodecoder.c:4797:_gst_video_decoder_error:
error: Failed to decode JPEG image
0:00:00.085385901 569 0x564ae45725e0 WARN videodecoder gstvideodecoder.c:4799:_gst_video_decoder_error:
error: Decode error #55: Not a JPEG file: starts with 0x0f 0x86
0:00:00.085436693 569 0x564ae45725e0 WARN videodecoder gstvideodecoder.c:4797:_gst_video_decoder_error:
error: Failed to decode JPEG image
0:00:00.085448829 569 0x564ae45725e0 WARN videodecoder gstvideodecoder.c:4799:_gst_video_decoder_error: error: Decode error #55: Not a JPEG file: starts with 0x78 0xa2
0:00:00.085493235 569 0x564ae45725e0 WARN videodecoder gstvideodecoder.c:4797:_gst_video_decoder_error: error: Failed to decode JPEG image
0:00:00.085508445 569 0x564ae45725e0 WARN videodecoder gstvideodecoder.c:4799:_gst_video_decoder_error: error: Decode error #55: Not a JPEG file: starts with 0x57 0x92
0:00:00.085547672 569 0x564ae45725e0 WARN videodecoder gstvideodecoder.c:4797:_gst_video_decoder_error: error: Failed to decode JPEG image
0:00:00.085555706 569 0x564ae45725e0 WARN videodecoder gstvideodecoder.c:4799:_gst_video_decoder_error: error: Decode error #55: Not a JPEG file: starts with 0x40 0xa8
0:00:00.085607789 569 0x564ae45725e0 WARN videodecoder gstvideodecoder.c:4797:_gst_video_decoder_error: error: Failed to decode JPEG image
0:00:00.085624775 569 0x564ae45725e0 WARN videodecoder gstvideodecoder.c:4799:_gst_video_decoder_error: error: Decode error #55: Not a JPEG file: starts with 0x41 0x4f
0:00:00.085672337 569 0x564ae45725e0 WARN videodecoder gstvideodecoder.c:4797:_gst_video_decoder_error: error: Failed to decode JPEG image
0:00:00.085684503 569 0x564ae45725e0 WARN videodecoder gstvideodecoder.c:4799:_gst_video_decoder_error: error: Decode error #55: Not a JPEG file: starts with 0x37 0xc5
0:00:00.085753791 569 0x564ae45725e0 WARN videodecoder gstvideodecoder.c:4797:_gst_video_decoder_error: error: Failed to decode JPEG image
0:00:00.085767010 569 0x564ae45725e0 WARN videodecoder gstvideodecoder.c:4799:_gst_video_decoder_error: error: Decode error #55: Not a JPEG file: starts with 0x66 0xb3
0:00:00.085825088 569 0x564ae45725e0 WARN videodecoder gstvideodecoder.c:4797:_gst_video_decoder_error: error: Failed to decode JPEG image
0:00:00.085833561 569 0x564ae45725e0 WARN videodecoder gstvideodecoder.c:4799:_gst_video_decoder_error: error: Decode error #55: Not a JPEG file: starts with 0xb4 0x44
0:00:00.085864028 569 0x564ae45725e0 WARN videodecoder gstvideodecoder.c:4797:_gst_video_decoder_error: error: Failed to decode JPEG image
0:00:00.085871133 569 0x564ae45725e0 WARN videodecoder gstvideodecoder.c:4799:_gst_video_decoder_error: error: Decode error #55: Not a JPEG file: starts with 0x4f 0x4a
0:00:00.085904865 569 0x564ae45725e0 WARN videodecoder gstvideodecoder.c:4797:_gst_video_decoder_error: error: Failed to decode JPEG image
0:00:00.085919454 569 0x564ae45725e0 WARN videodecoder gstvideodecoder.c:4799:_gst_video_decoder_error: error: Decode error #55: Not a JPEG file: starts with 0x00 0x02
0:00:00.085960327 569 0x564ae45725e0 WARN videodecoder gstvideodecoder.c:4797:_gst_video_decoder_error: error: Failed to decode JPEG image
0:00:00.085975907 569 0x564ae45725e0 WARN videodecoder gstvideodecoder.c:4799:_gst_video_decoder_error: error: Decode error #55: Not a JPEG file: starts with 0xdf 0xa8
ERROR: from element /GstPipeline:pipeline0/GstJpegDec:jpegdec0: Failed to decode JPEG image
Additional debug info:
../ext/jpeg/gstjpegdec.c(1557): gst_jpeg_dec_handle_frame (): /GstPipeline:pipeline0/GstJpegDec:jpegdec0:
Decode error #55: Not a JPEG file: starts with 0xdf 0xa8
ERROR: pipeline doesn't want to preroll.
Setting pipeline to NULL ...
0:00:00.086091329 569 0x564ae45725e0 WARN basesrc gstbasesrc.c:3127:gst_base_src_loop: error: Internal data stream error.
0:00:00.086105096 569 0x564ae45725e0 WARN basesrc gstbasesrc.c:3127:gst_base_src_loop: error: streaming stopped, reason error (-5) ERROR: from element /GstPipeline:pipeline0/GstTCPClientSrc:tcpclientsrc0: Internal data stream error.
Additional debug info:
../libs/gst/base/gstbasesrc.c(3127): gst_base_src_loop (): /GstPipeline:pipeline0/GstTCPClientSrc:tcpclientsrc0:
* without `do-timestamp=true` `tcpclientsrc host=127.0.0.1 port=5000`

GST_DEBUG=2 sh ./tcp_streaming_jpeg_receiver.sh
HOST=127.0.0.1
gst-launch-1.0 -tv tcpclientsrc host=127.0.0.1 port=5000 ! jpegdec ! videorate ! autovideosink Setting pipeline to PAUSED ... 0:00:00.052469961 575 0x55ac4c5d4d00 WARN xcontext xvcontext.c:538:gst_xvcontext_check_xshm_calls: MIT-SHM extension check failed at XShmAttach. Not using shared memory. 0:00:00.056096052 575 0x55ac4c5d4d00 WARN xcontext xvcontext.c:538:gst_xvcontext_check_xshm_calls: MIT-SHM extension check failed at XShmAttach. Not using shared memory. Pipeline is PREROLLING ... 0:00:00.076471492 575 0x55ac4c5bf1e0 WARN videodecoder gstvideodecoder.c:2816:gst_video_decoder_chain:
Received buffer without a new-segment. Assuming timestamps start from 0. /GstPipeline:pipeline0/GstJpegDec:jpegdec0.GstPad:src: caps = video/x-raw, format=(string)I420, width=(int)1280, height=(int)720, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, chroma-site=(string)jpeg, colorimetry=(string)1:4:0:0, framerate=(fraction)0/1 /GstPipeline:pipeline0/GstVideoRate:videorate0.GstPad:src: caps = video/x-raw, format=(string)I420, width=(int)1280, height=(int)720, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, chroma-site=(string)jpeg, colorimetry=(string)1:4:0:0, framerate=(fraction)0/1 /GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0.GstGhostPad:sink.GstProxyPad:proxypad0: caps = video/x-raw, format=(string)I420, width=(int)1280, height=(int)720, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, chroma-site=(string)jpeg, colorimetry=(string)1:4:0:0, framerate=(fraction)0/1 /GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstXvImageSink:autovideosink0-actual-sink-xvimage.GstPad:sink: caps = video/x-raw, format=(string)I420, width=(int)1280, height=(int)720, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, chroma-site=(string)jpeg, colorimetry=(string)1:4:0:0, framerate=(fraction)0/1 /GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0.GstGhostPad:sink: caps = video/x-raw, format=(string)I420, width=(int)1280, height=(int)720, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, chroma-site=(string)jpeg, colorimetry=(string)1:4:0:0, framerate=(fraction)0/1 /GstPipeline:pipeline0/GstVideoRate:videorate0.GstPad:sink: caps = video/x-raw, format=(string)I420, width=(int)1280, height=(int)720, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, chroma-site=(string)jpeg, colorimetry=(string)1:4:0:0, framerate=(fraction)0/1 0:00:00.114686382 575 0x55ac4c5bf1e0 WARN videorate gstvideorate.c:1496:gst_video_rate_transform_ip:
error: videorate requires a non-variable framerate on the output caps or the two first consecutive buffers to have valid timestamps to guess the framerate. ERROR: from element /GstPipeline:pipeline0/GstVideoRate:videorate0: GStreamer encountered a general stream error. Additional debug info: ../gst/videorate/gstvideorate.c(1496): gst_video_rate_transform_ip (): /GstPipeline:pipeline0/GstVideoRate:videorate0: videorate requires a non-variable framerate on the output caps or the two first consecutive buffers to have valid timestamps to guess the framerate. ERROR: pipeline doesn't want to preroll. Setting pipeline to NULL ... 0:00:00.114858886 575 0x55ac4c5bf1e0 WARN basesrc gstbasesrc.c:3127:gst_base_src_loop:
error: Internal data stream error. 0:00:00.114875104 575 0x55ac4c5bf1e0 WARN basesrc gstbasesrc.c:3127:gst_base_src_loop:
error: streaming stopped, reason error (-5) ERROR: from element /GstPipeline:pipeline0/GstTCPClientSrc:tcpclientsrc0: Internal data stream error. Additional debug info: ../libs/gst/base/gstbasesrc.c(3127): gst_base_src_loop (): /GstPipeline:pipeline0/GstTCPClientSrc:tcpclientsrc0: streaming stopped, reason error (-5) ERROR: pipeline doesn't want to preroll. ** ERROR:../gst/videorate/gstvideorate.c:714:gst_video_rate_push_buffer: assertion failed: (GST_BUFFER_DURATION_IS_VALID (outbuf)) Bail out! ERROR:../gst/videorate/gstvideorate.c:714:gst_video_rate_push_buffer: assertion failed: (GST_BUFFER_DURATION_IS_VALID (outbuf)) Aborted (core dumped)

stereoboy commented 1 year ago

with rtpstreampay/rtpstreamdepay

gst-launch-1.0 -tv tcpclientsrc host=$HOST port=5000 ! application/x-rtp-stream,encoding-name=JPEG ! rtpstreamdepay ! rtpjpegdepay ! jpegdec ! videorate ! autovideosink

0:00:02.714111175   343 0x56324dbad300 WARN               videorate gstvideorate.c:1789:gst_video_rate_transform_ip:<videorate0> Got buffer with GST_CLOCK_TIME_NONE timestamp, discarding it

stereoboy / gstreamer_samples

couldn't render frame when calling textoveraly/timeoverlay after tcpclientsrc #1