search

ant-media / Ant-Media-Server

Ant Media Server is a live streaming engine software that provides adaptive, ultra low latency streaming by using WebRTC technology with ~0.5 seconds latency. Ant Media Server is auto-scalable and it can run on-premise or on-cloud.
https://antmedia.io
Other
4.25k stars 626 forks source link

RTMP Endpoint is not deleting in a specific case #3920

Closed SelimEmre closed 1 year ago

SelimEmre commented 2 years ago

Short description

RTMP Endpoint is not deleting in a Cluster mode and broadcasting status.

Environment

Steps to reproduce

1- Use Ant Media Server cluster mode

  1. Add broadcast object and send stream via OBS
  2. Add RTMP Endpoint to created broadcast object
  3. Remove RTMP Endpoint from the broadcast object

Expected behavior

RTMP Endpoint should remove completely from the broadcast object

Actual behavior

It's not removing. It's only changing status to finished

Logs

2022-01-26 00:47:39,415 [RTMPConnectionExecutor-4] io.antmedia.enterprise.webrtc.WebRTCApplication - W3C x-category:session x-event:connect c-ip:127.0.0.1 c-client-id:6
2022-01-26 00:47:39,418 [RTMPConnectionExecutor-4] io.antmedia.security.AcceptOnlyStreamsWithWebhook - AcceptOnlyStreamsWithWebhook is not activated for stream bOflX07XMwEf1643147241507 webhook url: 
2022-01-26 00:47:39,418 [RTMPConnectionExecutor-4] io.antmedia.security.AcceptOnlyStreamsInDataStore - AcceptOnlyStreamsInDataStore is not activated. Accepting all streams bOflX07XMwEf1643147241507
2022-01-26 00:47:39,419 [RTMPConnectionExecutor-4] org.red5.server.scope.BasicScope - ClientBroadcastStream already exists: org.red5.server.stream.ClientBroadcastStream@405daa6c new: org.red5.server.stream.ClientBroadcastStream@405daa6c
2022-01-26 00:47:39,419 [RTMPConnectionExecutor-4] org.red5.server.stream.ClientBroadcastStream - Stream start: bOflX07XMwEf1643147241507
2022-01-26 00:47:39,420 [RTMPConnectionExecutor-4] io.antmedia.enterprise.webrtc.WebRTCApplication - W3C x-category:stream x-event:publish c-ip:127.0.0.1 x-sname:ba645811-fb1c-4bc8-bcb1-15f86e49035e x-name:bOflX07XMwEf1643147241507
2022-01-26 00:47:39,423 [RTMPConnectionExecutor-4] io.antmedia.datastore.db.MongoStore - result inside edit camera: false
2022-01-26 00:47:39,425 [RTMPConnectionExecutor-4] io.antmedia.AntMediaApplicationAdapter -  Status of stream bOflX07XMwEf1643147241507 is set to Broadcasting with result: true
2022-01-26 00:47:39,425 [RTMPConnectionExecutor-4] io.antmedia.muxer.MuxAdaptor - serverSettings exist io.antmedia.settings.ServerSettings@1ef1273d
2022-01-26 00:47:39,427 [RTMPConnectionExecutor-4] io.antmedia.muxer.MuxAdaptor - vertx exist io.vertx.core.impl.VertxImpl@cb83de3
2022-01-26 00:47:39,427 [RTMPConnectionExecutor-4] io.antmedia.muxer.MuxAdaptor - serverSettings exist io.antmedia.settings.ServerSettings@1ef1273d
2022-01-26 00:47:39,427 [RTMPConnectionExecutor-4] io.antmedia.muxer.MuxAdaptor - adding HLS Muxer for bOflX07XMwEf1643147241507
2022-01-26 00:47:39,428 [RTMPConnectionExecutor-4] io.antmedia.muxer.HLSMuxer - hls time: 2, hls list size: 5 for stream:bOflX07XMwEf1643147241507
2022-01-26 00:47:39,428 [RTMPConnectionExecutor-4] io.antmedia.muxer.MuxAdaptor - serverSettings exist io.antmedia.settings.ServerSettings@1ef1273d
2022-01-26 00:47:39,428 [RTMPConnectionExecutor-4] io.antmedia.muxer.MuxAdaptor - Number of items in the queue while adaptor is being started to prepare is 0
2022-01-26 00:47:39,428 [vert.x-worker-thread-21] io.antmedia.muxer.MuxAdaptor - before prepare for bOflX07XMwEf1643147241507
2022-01-26 00:47:39,428 [vert.x-worker-thread-21] io.antmedia.muxer.MuxAdaptor - Number of items in the queue while starting: 0 for stream: bOflX07XMwEf1643147241507
2022-01-26 00:47:39,428 [RTMPConnectionExecutor-4] org.red5.server.stream.AbstractStream - metadata read data type -->>>> core map
2022-01-26 00:47:39,428 [vert.x-eventloop-thread-8] io.antmedia.muxer.MuxAdaptor - muxadaptor start has finished with true for stream: bOflX07XMwEf1643147241507
2022-01-26 00:47:39,428 [RTMPConnectionExecutor-4] io.antmedia.muxer.MuxAdaptor - first received frame timestamp: 0 for stream:bOflX07XMwEf1643147241507 
2022-01-26 00:47:39,579 [vert.x-worker-thread-47] io.antmedia.muxer.parser.AACConfigParser - AAC object type:AAC_LC 
2022-01-26 00:47:39,579 [vert.x-worker-thread-47] io.antmedia.muxer.parser.AACConfigParser - AAC Sample rate:48000 
2022-01-26 00:47:39,579 [vert.x-worker-thread-47] io.antmedia.muxer.MuxAdaptor - Video and audio is enabled in stream:bOflX07XMwEf1643147241507 queue size: 4
2022-01-26 00:47:39,580 [vert.x-worker-thread-47] io.antmedia.muxer.MuxAdaptor - Incoming video width: 1920 height:1080 stream:bOflX07XMwEf1643147241507
2022-01-26 00:47:39,580 [vert.x-worker-thread-47] io.antmedia.enterprise.adaptive.EncoderAdaptor - not decoding video for stream: bOflX07XMwEf1643147241507
2022-01-26 00:47:39,580 [vert.x-worker-thread-47] io.antmedia.enterprise.adaptive.base.AudioDecoder - audio decoder name:  aac for bOflX07XMwEf1643147241507 sample rate:48000
2022-01-26 00:47:39,581 [vert.x-worker-thread-47] io.antmedia.enterprise.adaptive.StreamAdaptor - Stream adaptor scheduled job id 97 stream adaptor:1346627280 for stream:bOflX07XMwEf1643147241507
2022-01-26 00:47:39,581 [vert.x-worker-thread-47] io.antmedia.enterprise.adaptive.audio.OpusEncoder - encoder name libopus source sample rate 48000, channel layout 3
2022-01-26 00:47:39,581 [vert.x-worker-thread-47] io.antmedia.enterprise.webrtc.WebRTCAdaptor - registering bOflX07XMwEf1643147241507 muxer with 1080p and codec::H264 to webrtc adaptor
2022-01-26 00:47:39,581 [vert.x-worker-thread-47] io.antmedia.enterprise.webrtc.WebRTCAdaptor - Increasing number of live streams: 1 and stream id:bOflX07XMwEf1643147241507
2022-01-26 00:47:39,581 [vert.x-worker-thread-47] io.antmedia.enterprise.adaptive.EncoderAdaptor - getStreamInfoList size: 1 for stream: bOflX07XMwEf1643147241507
2022-01-26 00:47:39,581 [vert.x-worker-thread-47] io.antmedia.enterprise.cluster.webrtc.OriginServer - Origin Server is starting video enabled:true audio enabled: true for stream:bOflX07XMwEf1643147241507
2022-01-26 00:47:39,583 [vert.x-worker-thread-47] io.antmedia.AntMediaApplicationAdapter - start publish leaved for stream:bOflX07XMwEf1643147241507
2022-01-26 00:47:39,583 [vert.x-eventloop-thread-8] io.antmedia.enterprise.cluster.webrtc.OriginServer - Setting stream cluster origin video port 40331 for stream bOflX07XMwEf1643147241507
2022-01-26 00:47:39,584 [vert.x-eventloop-thread-8] io.antmedia.enterprise.cluster.webrtc.OriginServerStatusListener - video port(40331) for origin stream bOflX07XMwEf1643147241507
2022-01-26 00:47:39,584 [vert.x-eventloop-thread-8] io.antmedia.enterprise.cluster.webrtc.OriginServerStatusListener - OriginServer not ready. Current video:40331 audio:0 data:0 for stream: bOflX07XMwEf1643147241507 - codec:H264
2022-01-26 00:47:39,584 [vert.x-eventloop-thread-8] io.antmedia.enterprise.cluster.webrtc.OriginServer - Setting stream cluster origin audio port 45869 for stream bOflX07XMwEf1643147241507
2022-01-26 00:47:39,584 [vert.x-eventloop-thread-8] io.antmedia.enterprise.cluster.webrtc.OriginServerStatusListener - audio port(45869) for origin stream bOflX07XMwEf1643147241507
2022-01-26 00:47:39,584 [vert.x-eventloop-thread-8] io.antmedia.enterprise.cluster.webrtc.OriginServerStatusListener - OriginServer ready now. Video enabled/port:true/40331 Audio enabled/port:true/45869 Data Channel enabled/port:false/0 for stream bOflX07XMwEf1643147241507 with height: 1080 codec:H264
2022-01-26 00:47:39,584 [vert.x-eventloop-thread-8] io.antmedia.enterprise.webrtc.WebRTCMuxer - register webrtc client(331284695) to webrtc muxer(1080p - codec:H264) for stream: bOflX07XMwEf1643147241507 current viewer count:1
2022-01-26 00:47:39,585 [vert.x-worker-thread-33] io.antmedia.datastore.db.MongoStore - result inside edit camera: false
2022-01-26 00:47:39,586 [vert.x-worker-thread-33] io.antmedia.AntMediaApplicationAdapter -  Status of stream bOflX07XMwEf1643147241507 is set to Broadcasting with result: true
2022-01-26 00:47:41,584 [vert.x-eventloop-thread-8] io.antmedia.AntMediaApplicationAdapter - Broadcast absolute time is not available for stream:bOflX07XMwEf1643147241507
2022-01-26 00:47:52,579 [vert.x-worker-thread-42] io.antmedia.enterprise.adaptive.StreamAdaptor - Stream adaptor queue size: 0 for stream: bOflX07XMwEf1643147241507
2022-01-26 00:47:53,920 [http-nio2-0.0.0.0-5080-exec-7] io.antmedia.muxer.MuxAdaptor - start rtmp streaming for stream id:bOflX07XMwEf1643147241507 to rtmp://localhost/WebRTCAppEE/test2 with requested resolution height0 stream resolution:1080
2022-01-26 00:47:53,921 [http-nio2-0.0.0.0-5080-exec-7] io.antmedia.muxer.MuxAdaptor - prepareMuxer for stream:bOflX07XMwEf1643147241507 muxer:RtmpMuxer
2022-01-26 00:47:53,921 [http-nio2-0.0.0.0-5080-exec-7] io.antmedia.muxer.RtmpMuxer - Creating outputFormatContext
2022-01-26 00:47:53,922 [vert.x-worker-thread-61] io.antmedia.muxer.RtmpMuxer - rtmp muxer opening: rtmp://localhost/WebRTCAppEE/test2 time:1643147273922
2022-01-26 00:47:53,922 [http-nio2-0.0.0.0-5080-exec-7] io.antmedia.rest.RestServiceBase - IP: localhost
2022-01-26 00:47:53,925 [http-nio2-0.0.0.0-5080-exec-7] io.antmedia.rest.RestServiceBase - Rtmp endpoint(rtmp://localhost/WebRTCAppEE/test2) adding to the stream: bOflX07XMwEf1643147241507 is true
2022-01-26 00:47:53,931 [NioProcessor-9] org.red5.server.net.rtmp.InboundHandshake - Client not compatible
2022-01-26 00:47:53,932 [RTMPConnectionExecutor-2] io.antmedia.enterprise.webrtc.WebRTCApplication - W3C x-category:session x-event:connect c-ip:127.0.0.1 c-client-id:7
2022-01-26 00:47:53,939 [RTMPConnectionExecutor-1] io.antmedia.security.AcceptOnlyStreamsWithWebhook - AcceptOnlyStreamsWithWebhook is not activated for stream test2 webhook url: 
2022-01-26 00:47:53,939 [vert.x-worker-thread-22] io.antmedia.muxer.RtmpMuxer - Not writing AudioBuffer for rtmp://localhost/WebRTCAppEE/test2 because Is running:false
2022-01-26 00:47:53,939 [RTMPConnectionExecutor-1] io.antmedia.security.AcceptOnlyStreamsInDataStore - AcceptOnlyStreamsInDataStore is not activated. Accepting all streams test2
2022-01-26 00:47:53,942 [RTMPConnectionExecutor-1] org.red5.server.scope.BasicScope - ClientBroadcastStream already exists: org.red5.server.stream.ClientBroadcastStream@2d2e9534 new: org.red5.server.stream.ClientBroadcastStream@2d2e9534
2022-01-26 00:47:53,942 [RTMPConnectionExecutor-1] org.red5.server.stream.ClientBroadcastStream - Stream start: test2
2022-01-26 00:47:53,942 [RTMPConnectionExecutor-1] io.antmedia.enterprise.webrtc.WebRTCApplication - W3C x-category:stream x-event:publish c-ip:127.0.0.1 x-sname:53dca795-fa3e-4919-9f48-ba89e9973134 x-name:test2
2022-01-26 00:47:53,943 [vert.x-worker-thread-61] io.antmedia.muxer.RtmpMuxer - avio open takes 21
2022-01-26 00:47:53,943 [vert.x-worker-thread-61] io.antmedia.muxer.RtmpMuxer - before writing rtmp muxer header to rtmp://localhost/WebRTCAppEE/test2
2022-01-26 00:47:53,943 [vert.x-worker-thread-61] io.antmedia.muxer.RtmpMuxer - write header takes 0
2022-01-26 00:47:53,943 [vert.x-worker-thread-61] io.antmedia.muxer.MuxAdaptor - Endpoint status updated to broadcasting  for streamId: bOflX07XMwEf1643147241507 for url: rtmp://localhost/WebRTCAppEE/test2
2022-01-26 00:47:53,953 [RTMPConnectionExecutor-1] io.antmedia.muxer.MuxAdaptor - serverSettings exist io.antmedia.settings.ServerSettings@1ef1273d
2022-01-26 00:47:53,956 [RTMPConnectionExecutor-1] io.antmedia.muxer.MuxAdaptor - vertx exist io.vertx.core.impl.VertxImpl@cb83de3
2022-01-26 00:47:53,956 [RTMPConnectionExecutor-1] io.antmedia.muxer.MuxAdaptor - serverSettings exist io.antmedia.settings.ServerSettings@1ef1273d
2022-01-26 00:47:53,956 [RTMPConnectionExecutor-1] io.antmedia.muxer.MuxAdaptor - adding HLS Muxer for test2
2022-01-26 00:47:53,957 [RTMPConnectionExecutor-1] io.antmedia.muxer.HLSMuxer - hls time: 2, hls list size: 5 for stream:test2
2022-01-26 00:47:53,957 [RTMPConnectionExecutor-1] io.antmedia.muxer.MuxAdaptor - serverSettings exist io.antmedia.settings.ServerSettings@1ef1273d
2022-01-26 00:47:53,957 [RTMPConnectionExecutor-1] io.antmedia.muxer.MuxAdaptor - Number of items in the queue while adaptor is being started to prepare is 0
2022-01-26 00:47:53,957 [vert.x-worker-thread-5] io.antmedia.muxer.MuxAdaptor - before prepare for test2
2022-01-26 00:47:53,958 [RTMPConnectionExecutor-3] org.red5.server.stream.AbstractStream - metadata read data type -->>>> core map
2022-01-26 00:47:53,958 [RTMPConnectionExecutor-3] io.antmedia.muxer.MuxAdaptor - first received frame timestamp: 0 for stream:test2 
2022-01-26 00:47:53,960 [vert.x-worker-thread-5] io.antmedia.muxer.MuxAdaptor - Number of items in the queue while starting: 5 for stream: test2
2022-01-26 00:47:53,960 [vert.x-eventloop-thread-12] io.antmedia.muxer.MuxAdaptor - muxadaptor start has finished with true for stream: test2
2022-01-26 00:47:53,968 [vert.x-worker-thread-55] io.antmedia.muxer.parser.AACConfigParser - AAC object type:AAC_LC 
2022-01-26 00:47:53,969 [vert.x-worker-thread-55] io.antmedia.muxer.parser.AACConfigParser - AAC Sample rate:48000 
2022-01-26 00:47:53,969 [vert.x-worker-thread-55] io.antmedia.muxer.MuxAdaptor - Video and audio is enabled in stream:test2 queue size: 5
2022-01-26 00:47:53,969 [vert.x-worker-thread-55] io.antmedia.muxer.MuxAdaptor - Incoming video width: 1920 height:1080 stream:test2
2022-01-26 00:47:53,975 [vert.x-worker-thread-55] io.antmedia.enterprise.adaptive.EncoderAdaptor - not decoding video for stream: test2
2022-01-26 00:47:53,975 [vert.x-worker-thread-55] io.antmedia.enterprise.adaptive.base.AudioDecoder - audio decoder name:  aac for test2 sample rate:48000
2022-01-26 00:47:53,976 [vert.x-worker-thread-55] io.antmedia.enterprise.adaptive.StreamAdaptor - Stream adaptor scheduled job id 104 stream adaptor:593591978 for stream:test2
2022-01-26 00:47:53,976 [vert.x-worker-thread-55] io.antmedia.enterprise.adaptive.audio.OpusEncoder - encoder name libopus source sample rate 48000, channel layout 3
2022-01-26 00:47:53,977 [vert.x-worker-thread-55] io.antmedia.enterprise.webrtc.WebRTCAdaptor - registering test2 muxer with 1080p and codec::H264 to webrtc adaptor
2022-01-26 00:47:53,977 [vert.x-worker-thread-55] io.antmedia.enterprise.webrtc.WebRTCAdaptor - Increasing number of live streams: 2 and stream id:test2
2022-01-26 00:47:53,977 [vert.x-worker-thread-55] io.antmedia.enterprise.adaptive.EncoderAdaptor - getStreamInfoList size: 1 for stream: test2
2022-01-26 00:47:53,977 [vert.x-worker-thread-55] io.antmedia.enterprise.cluster.webrtc.OriginServer - Origin Server is starting video enabled:true audio enabled: true for stream:test2
2022-01-26 00:47:53,997 [vert.x-worker-thread-55] io.antmedia.AntMediaApplicationAdapter - start publish leaved for stream:test2
2022-01-26 00:47:54,004 [vert.x-eventloop-thread-12] io.antmedia.enterprise.cluster.webrtc.OriginServer - Setting stream cluster origin video port 46225 for stream test2
2022-01-26 00:47:54,005 [vert.x-eventloop-thread-12] io.antmedia.enterprise.cluster.webrtc.OriginServerStatusListener - video port(46225) for origin stream test2
2022-01-26 00:47:54,005 [vert.x-eventloop-thread-12] io.antmedia.enterprise.cluster.webrtc.OriginServerStatusListener - OriginServer not ready. Current video:46225 audio:0 data:0 for stream: test2 - codec:H264
2022-01-26 00:47:54,005 [vert.x-eventloop-thread-12] io.antmedia.enterprise.cluster.webrtc.OriginServer - Setting stream cluster origin audio port 46695 for stream test2
2022-01-26 00:47:54,005 [vert.x-worker-thread-41] io.antmedia.datastore.db.MongoStore - result inside edit camera: false
2022-01-26 00:47:54,005 [vert.x-eventloop-thread-12] io.antmedia.enterprise.cluster.webrtc.OriginServerStatusListener - audio port(46695) for origin stream test2
2022-01-26 00:47:54,006 [vert.x-eventloop-thread-12] io.antmedia.enterprise.cluster.webrtc.OriginServerStatusListener - OriginServer ready now. Video enabled/port:true/46225 Audio enabled/port:true/46695 Data Channel enabled/port:false/0 for stream test2 with height: 1080 codec:H264
2022-01-26 00:47:54,007 [vert.x-worker-thread-41] io.antmedia.AntMediaApplicationAdapter -  Status of stream test2 is set to Broadcasting with result: true
2022-01-26 00:47:54,009 [vert.x-eventloop-thread-12] io.antmedia.enterprise.webrtc.WebRTCMuxer - register webrtc client(341857968) to webrtc muxer(1080p - codec:H264) for stream: test2 current viewer count:1
2022-01-26 00:47:55,998 [vert.x-eventloop-thread-12] io.antmedia.AntMediaApplicationAdapter - Broadcast absolute time is not available for stream:test2
2022-01-26 00:47:56,261 [vert.x-worker-thread-1] io.antmedia.muxer.RtmpMuxer - Key frame is received to start
2022-01-26 00:47:56,948 [vert.x-eventloop-thread-11] io.antmedia.datastore.db.MongoStore - result inside edit camera: false
2022-01-26 00:48:05,579 [vert.x-worker-thread-28] io.antmedia.enterprise.adaptive.StreamAdaptor - Stream adaptor queue size: 0 for stream: bOflX07XMwEf1643147241507
2022-01-26 00:48:07,848 [vert.x-worker-thread-4] io.antmedia.enterprise.adaptive.StreamAdaptor - Stream adaptor queue size: 0 for stream: test2
2022-01-26 00:48:09,183 [http-nio2-0.0.0.0-5080-exec-26] io.antmedia.muxer.RtmpMuxer - Writing trailer for stream id: rtmp://localhost/WebRTCAppEE/test2
2022-01-26 00:48:09,183 [http-nio2-0.0.0.0-5080-exec-26] io.antmedia.muxer.MuxAdaptor - Endpoint status updated to finished  for streamId: bOflX07XMwEf1643147241507 for url: rtmp://localhost/WebRTCAppEE/test2
2022-01-26 00:48:09,184 [NioProcessor-9] org.red5.server.stream.ClientBroadcastStream - Checking mux adaptor to stop test2
2022-01-26 00:48:09,184 [NioProcessor-9] io.antmedia.muxer.MuxAdaptor - Calling stop for test2 input queue size:0
2022-01-26 00:48:09,184 [NioProcessor-9] org.red5.server.stream.ClientBroadcastStream - Mux Adaptor stop called test2
2022-01-26 00:48:09,185 [NioProcessor-9] io.antmedia.enterprise.webrtc.WebRTCApplication - W3C x-category:stream x-event:unpublish c-ip:127.0.0.1 cs-bytes:1975900 sc-bytes:3591 x-sname:53dca795-fa3e-4919-9f48-ba89e9973134 x-file-length:15 x-name:test2
2022-01-26 00:48:09,185 [NioProcessor-9] io.antmedia.enterprise.webrtc.WebRTCApplication - W3C x-category:session x-event:disconnect c-ip:127.0.0.1 c-client-id:7
2022-01-26 00:48:09,186 [RTMPConnectionExecutor-1] org.red5.server.net.rtmp.RTMPHandler - Not connected, closing connection
2022-01-26 00:48:09,186 [RTMPConnectionExecutor-1] org.red5.server.net.rtmp.RTMPHandler - Not connected, closing connection
2022-01-26 00:48:09,188 [vert.x-worker-thread-16] io.antmedia.muxer.MuxAdaptor - closing adaptor for test2 
2022-01-26 00:48:09,188 [vert.x-worker-thread-16] io.antmedia.muxer.MuxAdaptor - close resources for streamId -> test2
2022-01-26 00:48:09,188 [vert.x-worker-thread-16] io.antmedia.muxer.MuxAdaptor - Cancelling packet poller task(id:103) for streamId: test2
2022-01-26 00:48:09,189 [vert.x-worker-thread-16] io.antmedia.muxer.HLSMuxer - Delete File onexit:true upload to S3:true stream:test2 hls time:2 hlslist size:5 
2022-01-26 00:48:09,193 [vert.x-worker-thread-16] io.antmedia.enterprise.adaptive.EncoderAdaptor - closing input and number of dropped packets 0
2022-01-26 00:48:09,193 [vert.x-worker-thread-16] io.antmedia.enterprise.adaptive.EncoderAdaptor - Total video encode time 0ms, average video encode time 0ms total audio encode time 41ms total video decode time 0ms , average video decode time 0 ms 
2022-01-26 00:48:09,193 [vert.x-worker-thread-16] io.antmedia.muxer.MuxAdaptor - closed adaptor for test2
2022-01-26 00:48:09,193 [vert.x-worker-thread-16] io.antmedia.AntMediaApplicationAdapter - Closing broadcast stream id: test2
2022-01-26 00:48:09,196 [vert.x-worker-thread-41] io.antmedia.enterprise.adaptive.StreamAdaptor - Recording set to false in streamadaptor: 593591978 for stream: test2 stopping scheduler job id: 104
2022-01-26 00:48:09,197 [vert.x-worker-thread-41] io.antmedia.enterprise.adaptive.StreamAdaptor - Flushing video encoder:SFUForwarder for stream adaptor:593591978 stream id:test2
2022-01-26 00:48:09,198 [vert.x-worker-thread-41] io.antmedia.enterprise.adaptive.StreamAdaptor - Flushing audio encoder:libopus for stream adaptor:593591978 stream id:test2
2022-01-26 00:48:09,199 [vert.x-worker-thread-41] io.antmedia.enterprise.webrtc.WebRTCAdaptor - unregistering test2 muxer with 1080p and codec: H264 from webrtc adaptor
2022-01-26 00:48:09,199 [vert.x-worker-thread-41] io.antmedia.enterprise.webrtc.WebRTCAdaptor - Decreasing number of live streams: 1 and stream id:test2
2022-01-26 00:48:09,199 [vert.x-worker-thread-41] io.antmedia.enterprise.webrtc.WebRTCMuxer - Average write packet call interval for video 33ms average video packet processing time 0ms video packet count: 388 for stream:test2
2022-01-26 00:48:09,199 [vert.x-worker-thread-41] io.antmedia.enterprise.webrtc.WebRTCMuxer - Average write packet call interval: 19ms average audio processing time: 0ms  audio packet count: 761 for stream:test2
2022-01-26 00:48:09,199 [vert.x-worker-thread-41] io.antmedia.enterprise.webrtc.WebRTCMuxer - WebRTC Client 341857968 video frame average sent period: 33.273197  audio frame average period: 19.947437 for stream:test2 type:OriginServer
2022-01-26 00:48:09,199 [vert.x-worker-thread-41] io.antmedia.enterprise.cluster.webrtc.OriginServer - Stoping Origin Server for stream Id test2 resolution is 1080
2022-01-26 00:48:09,199 [vert.x-worker-thread-41] io.antmedia.enterprise.webrtc.WebRTCMuxer - unregister webrtc client(341857968) to webrtc muxer(1080p - codec:H264) for stream: test2 current viewer count:0 decremented:true
2022-01-26 00:48:09,205 [http-nio2-0.0.0.0-5080-exec-26] io.antmedia.rest.RestServiceBase - Rtmp endpoint(rtmp://localhost/WebRTCAppEE/test2) removal operation is true from the stream: bOflX07XMwEf1643147241507
2022-01-26 00:48:09,209 [vert.x-worker-thread-41] io.antmedia.enterprise.cluster.webrtc.OriginServer - Origin server is stopped for stream id: test2 and height:1080
2022-01-26 00:48:09,210 [vert.x-worker-thread-41] io.antmedia.enterprise.adaptive.video.SFUForwarder - Video codec writing trailer name: SFUForwarder height:1080 for stream:test2
2022-01-26 00:48:09,210 [vert.x-worker-thread-41] io.antmedia.enterprise.adaptive.video.SFUForwarder - Total processing time 0 ms Average processing time 0 ms per frame for stream:test2
2022-01-26 00:48:09,210 [vert.x-worker-thread-41] io.antmedia.enterprise.adaptive.audio.OpusEncoder - writing trailer codec name: libopus bitrate:96000 for stream:test2
2022-01-26 00:48:09,210 [vert.x-worker-thread-41] io.antmedia.enterprise.adaptive.audio.OpusEncoder - Total processing time 2656, Average processing time 1 ms per frame on average for stream:test2
2022-01-26 00:48:09,210 [vert.x-worker-thread-41] io.antmedia.enterprise.adaptive.StreamAdaptor - Average thread entrance interval 9ms for stream: test2
2022-01-26 00:48:09,210 [vert.x-worker-thread-41] io.antmedia.enterprise.adaptive.StreamAdaptor - Leaving streamadaptor: 593591978 for stream: test2
2022-01-26 00:48:12,188 [vert.x-eventloop-thread-13] io.antmedia.datastore.db.MongoStore - result inside edit camera: false
2022-01-26 00:48:18,599 [vert.x-worker-thread-53] io.antmedia.enterprise.adaptive.StreamAdaptor - Stream adaptor queue size: 0 for stream: bOflX07XMwEf1643147241507
2022-01-26 00:48:31,609 [vert.x-worker-thread-48] io.antmedia.enterprise.adaptive.StreamAdaptor - Stream adaptor queue size: 0 for stream: bOflX07XMwEf1643147241507
2022-01-26 00:48:44,630 [vert.x-worker-thread-14] io.antmedia.enterprise.adaptive.StreamAdaptor - Stream adaptor queue size: 0 for stream: bOflX07XMwEf1643147241507
2022-01-26 00:48:57,629 [vert.x-worker-thread-50] io.antmedia.enterprise.adaptive.StreamAdaptor - Stream adaptor queue size: 0 for stream: bOflX07XMwEf1643147241507
2022-01-26 00:49:10,619 [vert.x-worker-thread-45] io.antmedia.enterprise.adaptive.StreamAdaptor - Stream adaptor queue size: 1 for stream: bOflX07XMwEf1643147241507
2022-01-26 00:49:23,640 [vert.x-worker-thread-26] io.antmedia.enterprise.adaptive.StreamAdaptor - Stream adaptor queue size: 1 for stream: bOflX07XMwEf1643147241507
2022-01-26 00:49:36,649 [vert.x-worker-thread-23] io.antmedia.enterprise.adaptive.StreamAdaptor - Stream adaptor queue size: 0 for stream: bOflX07XMwEf1643147241507
2022-01-26 00:49:49,659 [vert.x-worker-thread-56] io.antmedia.enterprise.adaptive.StreamAdaptor - Stream adaptor queue size: 0 for stream: bOflX07XMwEf1643147241507
2022-01-26 00:49:56,084 [NioProcessor-8] org.red5.server.stream.ClientBroadcastStream - Checking mux adaptor to stop bOflX07XMwEf1643147241507
2022-01-26 00:49:56,084 [RTMPConnectionExecutor-4] org.red5.server.net.rtmp.RTMPHandler - Not connected, closing connection
2022-01-26 00:49:56,084 [NioProcessor-8] io.antmedia.muxer.MuxAdaptor - Calling stop for bOflX07XMwEf1643147241507 input queue size:0
2022-01-26 00:49:56,084 [NioProcessor-8] org.red5.server.stream.ClientBroadcastStream - Mux Adaptor stop called bOflX07XMwEf1643147241507
2022-01-26 00:49:56,084 [NioProcessor-8] io.antmedia.enterprise.webrtc.WebRTCApplication - W3C x-category:stream x-event:unpublish c-ip:127.0.0.1 cs-bytes:19944150 sc-bytes:3702 x-sname:ba645811-fb1c-4bc8-bcb1-15f86e49035e x-file-length:136 x-name:bOflX07XMwEf1643147241507
2022-01-26 00:49:56,084 [NioProcessor-8] io.antmedia.enterprise.webrtc.WebRTCApplication - W3C x-category:session x-event:disconnect c-ip:127.0.0.1 c-client-id:6
2022-01-26 00:49:56,088 [vert.x-worker-thread-6] io.antmedia.muxer.MuxAdaptor - closing adaptor for bOflX07XMwEf1643147241507 
2022-01-26 00:49:56,089 [vert.x-worker-thread-6] io.antmedia.muxer.MuxAdaptor - close resources for streamId -> bOflX07XMwEf1643147241507
2022-01-26 00:49:56,089 [vert.x-worker-thread-6] io.antmedia.muxer.MuxAdaptor - Cancelling packet poller task(id:96) for streamId: bOflX07XMwEf1643147241507
2022-01-26 00:49:56,090 [vert.x-worker-thread-6] io.antmedia.muxer.HLSMuxer - Delete File onexit:true upload to S3:true stream:bOflX07XMwEf1643147241507 hls time:2 hlslist size:5 
2022-01-26 00:49:56,092 [vert.x-worker-thread-6] io.antmedia.enterprise.adaptive.EncoderAdaptor - closing input and number of dropped packets 0
2022-01-26 00:49:56,092 [vert.x-worker-thread-6] io.antmedia.enterprise.adaptive.EncoderAdaptor - Total video encode time 0ms, average video encode time 0ms total audio encode time 528ms total video decode time 0ms , average video decode time 0 ms 
2022-01-26 00:49:56,092 [vert.x-worker-thread-6] io.antmedia.muxer.MuxAdaptor - closed adaptor for bOflX07XMwEf1643147241507
2022-01-26 00:49:56,092 [vert.x-worker-thread-32] io.antmedia.AntMediaApplicationAdapter - Closing broadcast stream id: bOflX07XMwEf1643147241507
2022-01-26 00:49:56,095 [vert.x-worker-thread-32] io.antmedia.statistic.HlsViewerStats - Reset HLS Stream ID: bOflX07XMwEf1643147241507 remove failed or null
2022-01-26 00:49:56,101 [vert.x-worker-thread-25] io.antmedia.enterprise.adaptive.StreamAdaptor - Recording set to false in streamadaptor: 1346627280 for stream: bOflX07XMwEf1643147241507 stopping scheduler job id: 97
2022-01-26 00:49:56,102 [vert.x-worker-thread-25] io.antmedia.enterprise.adaptive.StreamAdaptor - Flushing video encoder:SFUForwarder for stream adaptor:1346627280 stream id:bOflX07XMwEf1643147241507
2022-01-26 00:49:56,103 [vert.x-worker-thread-25] io.antmedia.enterprise.adaptive.StreamAdaptor - Flushing audio encoder:libopus for stream adaptor:1346627280 stream id:bOflX07XMwEf1643147241507
2022-01-26 00:49:56,103 [vert.x-worker-thread-25] io.antmedia.enterprise.webrtc.WebRTCAdaptor - unregistering bOflX07XMwEf1643147241507 muxer with 1080p and codec: H264 from webrtc adaptor
2022-01-26 00:49:56,103 [vert.x-worker-thread-25] io.antmedia.enterprise.webrtc.WebRTCAdaptor - Decreasing number of live streams: 0 and stream id:bOflX07XMwEf1643147241507
2022-01-26 00:49:56,104 [vert.x-worker-thread-25] io.antmedia.enterprise.webrtc.WebRTCMuxer - Average write packet call interval for video 33ms average video packet processing time 0ms video packet count: 4095 for stream:bOflX07XMwEf1643147241507
2022-01-26 00:49:56,104 [vert.x-worker-thread-25] io.antmedia.enterprise.webrtc.WebRTCMuxer - Average write packet call interval: 19ms average audio processing time: 0ms  audio packet count: 6825 for stream:bOflX07XMwEf1643147241507
2022-01-26 00:49:56,104 [vert.x-worker-thread-25] io.antmedia.enterprise.webrtc.WebRTCMuxer - WebRTC Client 331284695 video frame average sent period: 33.32381  audio frame average period: 19.997215 for stream:bOflX07XMwEf1643147241507 type:OriginServer
2022-01-26 00:49:56,104 [vert.x-worker-thread-25] io.antmedia.enterprise.cluster.webrtc.OriginServer - Stoping Origin Server for stream Id bOflX07XMwEf1643147241507 resolution is 1080
2022-01-26 00:49:56,104 [vert.x-worker-thread-25] io.antmedia.enterprise.webrtc.WebRTCMuxer - unregister webrtc client(331284695) to webrtc muxer(1080p - codec:H264) for stream: bOflX07XMwEf1643147241507 current viewer count:0 decremented:true
2022-01-26 00:49:56,108 [vert.x-worker-thread-25] io.antmedia.enterprise.cluster.webrtc.OriginServer - Origin server is stopped for stream id: bOflX07XMwEf1643147241507 and height:1080
2022-01-26 00:49:56,108 [vert.x-worker-thread-25] io.antmedia.enterprise.adaptive.video.SFUForwarder - Video codec writing trailer name: SFUForwarder height:1080 for stream:bOflX07XMwEf1643147241507
2022-01-26 00:49:56,108 [vert.x-worker-thread-25] io.antmedia.enterprise.adaptive.video.SFUForwarder - Total processing time 0 ms Average processing time 0 ms per frame for stream:bOflX07XMwEf1643147241507
2022-01-26 00:49:56,108 [vert.x-worker-thread-25] io.antmedia.enterprise.adaptive.audio.OpusEncoder - writing trailer codec name: libopus bitrate:96000 for stream:bOflX07XMwEf1643147241507
2022-01-26 00:49:56,108 [vert.x-worker-thread-25] io.antmedia.enterprise.adaptive.audio.OpusEncoder - Total processing time 24679, Average processing time 1 ms per frame on average for stream:bOflX07XMwEf1643147241507
2022-01-26 00:49:56,108 [vert.x-worker-thread-25] io.antmedia.enterprise.adaptive.StreamAdaptor - Average thread entrance interval 9ms for stream: bOflX07XMwEf1643147241507
2022-01-26 00:49:56,108 [vert.x-worker-thread-25] io.antmedia.enterprise.adaptive.StreamAdaptor - Leaving streamadaptor: 1346627280 for stream: bOflX07XMwEf1643147241507
2022-01-26 00:49:59,206 [vert.x-eventloop-thread-0] io.antmedia.statistic.StatsCollector - System cpu load:29 process cpu load:1 available memory: 1716820 KB used memory(RSS): 1228532 KB
2022-01-26 00:49:59,206 [vert.x-eventloop-thread-0] io.antmedia.statistic.StatsCollector - Vertx worker queue size:0 WebRTCVertx worker queue size:0
SelimEmre commented 1 year ago

It's already fixed. I tested with Cluster environment. I couldn't reproduce this issue with healthy/unhealthy sources. So, we can close this issue.