aws-samples / amazon-transcribe-live-meeting-assistant

MIT No Attribution
77 stars 27 forks source link

When screen sharing in Zoom, the virtual-participant does not function correctly. #116

Open t-narita1112 opened 1 month ago

t-narita1112 commented 1 month ago

Hello I would like to report an issue related to the virtual-participant feature.

Describe the bug When sharing the screen in Zoom, the transcription feature of the virtual participant does not function correctly. Depending on the timing of starting the screen share, the following issues occur:

  1. Inviting the virtual participant to the meeting after starting screen sharing →No meeting is created in the LMA. After a certain period of time, the virtual participant leaves the meeting.

  2. Starting screen sharing after inviting the virtual participant to the meeting →A meeting is created in the LMA, but the speaker is incorrectly identified.

To Reproduce Here are the steps to reproduce the issue:

  1. Inviting the virtual participant to the meeting after starting screen sharing

  2. Start a Zoom meeting.

  3. A participant in Zoom starts screen sharing.

  4. Invite the virtual-participant to the meeting.

  5. No Meetings are created in LMA, and after a certain amount of time, the virtual-participant leaves the meeting.

  6. Starting screen sharing after inviting the virtual participant to the meeting

  7. Start a Zoom meeting.

  8. Invite the virtual-participant to the meeting.

  9. A participant in Zoom starts screen sharing.

  10. Meetings are created in LMA, and the spoken content is transcribed, but the speaker is incorrectly identified (it appears to be fixed to one person).

Expected behavior The virtual-participant should function correctly even when screen sharing is active.