search

ossrs / srs

SRS is a simple, high-efficiency, real-time video server supporting RTMP, WebRTC, HLS, HTTP-FLV, SRT, MPEG-DASH, and GB28181.
https://ossrs.io
MIT License
24.72k stars 5.28k forks source link

Difficulties to playback WebRTC published media using RTMP with FFPLAY on MacOS #3988

Closed neilyoung closed 3 months ago

neilyoung commented 3 months ago

Long title, sorry, but it says it all:

I can see the RTMP doing some startup in the SRS console:

[2024-03-16 13:13:32.553][INFO][34555][1603cx43] RTMP client ip=192.168.188.53:63409, fd=13
[2024-03-16 13:13:32.554][INFO][34555][1603cx43] complex handshake success
[2024-03-16 13:13:32.554][INFO][34555][1603cx43] connect app, tcUrl=rtmp://192.168.188.53:1935/live, pageUrl=, swfUrl=, schema=rtmp, vhost=192.168.188.53, port=1935, app=live, args=null
[2024-03-16 13:13:32.554][INFO][34555][1603cx43] protocol in.buffer=0, in.ack=0, out.ack=0, in.chunk=128, out.chunk=128
[2024-03-16 13:13:32.554][INFO][34555][1603cx43] ignore AMF0/AMF3 command message.
[2024-03-16 13:13:32.554][INFO][34555][1603cx43] ignore AMF0/AMF3 command message.
[2024-03-16 13:13:32.554][INFO][34555][1603cx43] client identified, type=rtmp-play, vhost=192.168.188.53, app=live, stream=livestream, param=, duration=-1ms
[2024-03-16 13:13:32.554][INFO][34555][1603cx43] connected stream, tcUrl=rtmp://192.168.188.53:1935/live, pageUrl=, swfUrl=, schema=rtmp, vhost=__defaultVhost__, port=1935, app=live, stream=livestream, param=, args=null
[2024-03-16 13:13:32.554][INFO][34555][1603cx43] source url=/live/livestream, ip=192.168.188.53, cache=1/2500, is_edge=0, source_id=/
[2024-03-16 13:13:32.554][INFO][34555][1603cx43] create consumer, active=0, queue_size=30000ms, jitter=1
[2024-03-16 13:13:32.554][INFO][34555][1603cx43] set fd=13, SO_SNDBUF=146988=>87500, buffer=350ms
[2024-03-16 13:13:32.554][INFO][34555][1603cx43] start play smi=0ms, mw_sleep=350, mw_msgs=8, realtime=0, tcp_nodelay=0
[2024-03-16 13:13:32.554][INFO][34555][1603cx43] -> PLA time=0, msgs=0, okbps=0,0,0, ikbps=0,0,0, mw=350/8
[2024-03-16 13:13:34.923][INFO][34555][f93855z5] Hybrid cpu=0.00%,0MB, cid=1,1, timer=62,10,48, clock=0,36,11,1,0,0,0,0,0, objs=(pkt:113,raw:60,fua:52,msg:113,oth:1,buf:113)
[2024-03-16 13:13:34.923][INFO][34555][f93855z5] RTC: Server conns=1, rpkts=(115,rtp:113,stun:1,rtcp:1), spkts=(14,rtp:0,stun:1,rtcp:27), rtcp=(pli:0,twcc:9,rr:1), snk=(96,a:48,v:48,h:0), fid=(id:0,fid:115,ffid:0,addr:1,faddr:115)
[2024-03-16 13:13:35.624][INFO][34555][89981lov] Process: cpu=0.00%,0MB, threads=2
[2024-03-16 13:13:37.121][INFO][34555][00636992] <- RTC RECV #12, udp 1169, pps 226/116, schedule 1169
[2024-03-16 13:13:39.924][INFO][34555][f93855z5] Hybrid cpu=0.00%,0MB, cid=2,2, timer=61,10,48, clock=0,38,10,1,0,0,0,0,0, objs=(pkt:106,raw:62,fua:43,msg:107,oth:0,buf:106)
[2024-03-16 13:13:39.924][INFO][34555][f93855z5] RTC: Server conns=1, rpkts=(108,rtp:106,stun:1,rtcp:1), spkts=(14,rtp:0,stun:1,rtcp:27), rtcp=(pli:0,twcc:9,rr:1), snk=(96,a:48,v:48,h:0), fid=(id:0,fid:108,ffid:0,addr:1,faddr:108)
[2024-03-16 13:13:40.631][INFO][34555][89981lov] Process: cpu=0.00%,0MB, threads=2
[2024-03-16 13:13:44.924][INFO][34555][f93855z5] Hybrid cpu=0.00%,0MB, cid=2,2, timer=61,10,48, clock=0,38,10,1,0,0,0,0,0, objs=(pkt:106,raw:62,fua:43,msg:107,oth:0,buf:106)
[2024-03-16 13:13:44.925][INFO][34555][f93855z5] RTC: Server conns=1, rpkts=(108,rtp:106,stun:1,rtcp:1), spkts=(14,rtp:0,stun:1,rtcp:27), rtcp=(pli:0,twcc:9,rr:1), snk=(96,a:48,v:48,h:0), fid=(id:0,fid:108,ffid:0,addr:1,faddr:108)
[2024-03-16 13:13:45.634][INFO][34555][89981lov] Process: cpu=0.00%,0MB, threads=2

But the FFPLAY console doesn't open up the video window, it just shows:

56.  6.100
$ ffplay rtmp://192.168.188.53/live/livestream
ffplay version 5.1.4 Copyright (c) 2003-2023 the FFmpeg developers
  built with Apple clang version 15.0.0 (clang-1500.1.0.2.5)
  configuration: --prefix='/opt/homebrew/Cellar/ffmpeg@5/5.1.4_4' --datadir='/opt/homebrew/Cellar/ffmpeg@5/5.1.4_4/share/ffmpeg' --enable-shared --enable-pthreads --enable-version3 --cc=clang --host-cflags= --host-ldflags='-Wl,-ld_classic' --enable-ffplay --enable-gnutls --enable-gpl --enable-libaom --enable-libaribb24 --enable-libbluray --enable-libdav1d --enable-libmp3lame --enable-libopus --enable-librav1e --enable-librist --enable-librubberband --enable-libsnappy --enable-libsrt --enable-libsvtav1 --enable-libtesseract --enable-libtheora --enable-libvidstab --enable-libvmaf --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxml2 --enable-libxvid --enable-lzma --enable-libfontconfig --enable-libfreetype --enable-frei0r --enable-libass --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libspeex --enable-libsoxr --enable-libzmq --enable-libzimg --disable-libjack --disable-indev=jack --enable-videotoolbox --enable-neon
  libavutil      57. 28.100 / 57. 28.100
  libavcodec     59. 37.100 / 59. 37.100
  libavformat    59. 27.100 / 59. 27.100
  libavdevice    59.  7.100 / 59.  7.100
  libavfilter     8. 44.100 /  8. 44.100
  libswscale      6.  7.100 /  6.  7.100
  libswresample   4.  7.100 /  4.  7.100
  libpostproc    56.  6.100 / 56.  6.100
    nan    :  0.000 fd=   0 aq=    0KB vq=    0KB sq=    0B f=0/0

Shouldn't that work?

neilyoung commented 3 months ago

PS: Also not working with localhost as RTMP host

neilyoung commented 3 months ago

Ok, I found that I had rtc_to_rtmp off; in my conf. Works now. But 5 sec latency is far beyond everything acceptable for being considered as working playback solution. This is more or less not working, even if it "works" seemingly.

I'm looking for a real-time way to get the media out of SRS server-side in order to provide an RTSP feed (e.g. by using MediaMTX). I have experiences with this stuff, having done WebRTC to RTSP conversion with Kurento Media Server and MediaSoup. All of these transitions have been done with SUB SECOND latency using FFMPEG and SDP directly hooking up to a TCP UDP port carrying RTP. Nothing like this possible with SRS?

EDIT: And with sub second latency I mean the latency between camera and RTSP output...

winlinvip commented 3 months ago

This issue is addressed in the Wiki, please refer to the documentation. The issue will be deleted, kindly read the FAQ first: #2716.

TRANS_BY_GPT4