search

ant-media / Ant-Media-Server

Ant Media Server is a live streaming engine software that provides adaptive, ultra low latency streaming by using WebRTC technology with ~0.5 seconds latency. Ant Media Server is auto-scalable and it can run on-premise or on-cloud.
https://antmedia.io
Other
4.31k stars 637 forks source link

Merged MCU streams do not work with audio only publishers #4682

Open KamilBeda opened 1 year ago

KamilBeda commented 1 year ago

We are experiencing an issue with our app when trying to create merged MCU streams with different users publishing audio-only or camera + audio content. The issue occurs when an audio-only publisher joins the room: the stream breaks down and there is no audio output on the receiver end, with the video appearing black.

Environment

Steps to reproduce

  1. Create WebRTCAdaptor for publisher and set mediaConstraints.video to false
  2. Join the room and start publishing in MCU mode
  3. Try to preview the merged stream in playOnly mode

Expected behavior

Publisher can join the room with audio only and stream recievers can hear audio output. Streams merging merges video+audio streams with audio only streams. I think that https://github.com/ant-media/StreamApp/blob/master/src/main/webapp/conference.html example should be extended to include audioOnly query parameter which makes the stream audio only.

Actual behavior

the stream breaks down when the audio-only publisher joins the room, with no audio output and a black video. When we preview the individual streams, they work as expected, but the merged stream is broken. I don't know if this is related to this issue but the example MCU audio only example at https://ovh36.antmedia.io:5443/WebRTCAppEE/mcu.html?audioOnly is borken in the same way for me. There is no audio output when I join the room in playOnly mode at https://ovh36.antmedia.io:5443/WebRTCAppEE/mcu.html?playOnly

mekya commented 1 year ago

Thank you @KamilBeda . I think we've resolved this issue in the latest snapshot but let's confirm it.

PiotrBaczkowski commented 1 year ago

Is there way we can get latest snapshot on aws marketplace to verify?

mekya commented 1 year ago

Hi @PiotrBaczkowski ,

We eventually expect to have new release 2.5.2.

Yes, of course you can get the latest snapshot to try on aws marketplace from contact@antmedia.io If you have an account at antmedia.io, then it's always available in the Subscriptions> Downloads and updated automatically with changelog https://antmedia.io/changelog/changelog.html

Regards Oguz

Mohit-3196 commented 1 year ago

Hi @KamilBeda, How are you? I made some tests and it seems that audio only MCU is not working as expected. Even when trying to create a MCU room with audio only streams only, still there are some issue. I will make some more tests and keep you updated.

Thank you

burak-58 commented 1 year ago

https://github.com/ant-media/Plugins/pull/53