bigbluebutton / bbb-transcription-controller

7 stars 3 forks source link

Closed captioning chat for deafblind users #9

Open discapacidad5 opened 4 months ago

discapacidad5 commented 4 months ago

Problem:

Current automatic speech recognition (ASR) solutions for video conferencing, including BigBlueButton, do not adequately address the needs of deafblind users. While real-time transcriptions can be helpful for deaf users, they are not accessible to blind users who rely on screen readers. Additionally, real-time transcriptions are not helpful for deafblind users who cannot see the captions or hear the audio.

Deafblindness is a condition that affects both vision and hearing. It can be caused by a variety of factors, including congenital conditions, injuries, and diseases. Deafblind people experience the world in a unique way, and they have specific needs that must be considered when designing technology.

Deafblind people are the most vulnerable and isolated population due to a lack of technology that is adapted to their needs. They often have difficulty accessing education, employment, and social activities.

Solution:

We propose a new feature that would create a closed captioning chat for deafblind users. This chat would display the transcription of the conversation in real time, allowing deafblind users to read it at their own pace. Additionally, the chat would allow users to:

Scroll back through the conversation history Export the transcript for later review Distinguish between speakers (if available) Benefits:

This feature would greatly improve the accessibility of video conferencing for deafblind users, allowing them to participate more fully in online meetings and classes. It would also make BigBlueButton a more inclusive platform, setting an example for other video conferencing providers.

Implementation:

This feature could be implemented by adding a new tab to the BigBlueButton interface that displays the closed captioning chat. The chat would be populated with the real-time transcription of the conversation, and users would be able to scroll back through the history, export the transcript, and distinguish between speakers.

Call to action:

We urge BigBlueButton to consider implementing this feature as soon as possible. It would make a significant difference in the lives of deafblind users, and it would help to make BigBlueButton a more inclusive platform.

antobinary commented 4 months ago

Possible cross post on https://github.com/bigbluebutton/bigbluebutton/issues/19793 -- let's continue the conversation there please.