aws / amazon-chime-sdk-js

A JavaScript client library for integrating multi-party communications powered by the Amazon Chime service.
Apache License 2.0
713 stars 476 forks source link

Media Capture Pipeline unreliable when multiple video streams are recorded in a meeting #2704

Closed Manuel-AWS closed 1 year ago

Manuel-AWS commented 1 year ago

What happened and what did you expect to happen?

There is an issue when multiple video streams are recorded in a meeting.

The workaround temporarily suggested by AWS is to use composited video for the recording as per this blog post: https://aws.amazon.com/blogs/business-productivity/capture-amazon-chime-sdk-meetings-using-media-capture-pipelines/

Such workaround does not allow to capture all attendees' video when content is shared. It only captures a maximum of 4. Additionally, this is not useful when the use case requires the individual video streams, for example when required for a custom way to compose them and to add content from outside of the meeting.

That means we currently have zero ways to reliably record all attendees in our meetings, which is one of the core features of our application.

Have you reviewed our existing documentation?

Reproduction steps

Attempt to use Media Capture Pipeline to record multiple video streams in a Chime SDK video conference call.

Amazon Chime SDK for JavaScript version

3.15.0

What browsers are you seeing the problem on?

n/a

Browser version

n/a

Meeting and Attendee ID Information.

No response

Browser console logs

n/a

anuranduttaroy commented 1 year ago

Hey @Manuel-AWS, could you elaborate a bit on the issue that you are noticing when multiple video streams are recorded using Amazon Chime SDK Media Capture Pipelines?