MidCamp / live-captioning

Live caption with speech-to-text using the Chrome browser and your computer's microphone.
https://lc.midcamp.org/
GNU General Public License v3.0
159 stars 29 forks source link

Uses for Live Camera Feed Overlay? #4

Open backlineint opened 5 years ago

backlineint commented 5 years ago

Would there be any value in incorporating a video feed using the user's camera? On one hand, it might be redundant considering that we're already captioning the audio. But I also wonder if having video could provide additional context to support the captioning, or could be used to project an interpreter if they are participating in the event.

Similar to the microphone, getting access to the camera only requires a small amount of code. Since I'm still on the fence about how useful this is, I just created a super quick prototype. PR incoming.

cosmicdreams commented 5 years ago

Can we require that this is run in Chrome? Or rather a browser that supports the Picture-in-Picture spec? https://www.zdnet.com/article/google-chrome-picture-in-picture-support-is-now-live-for-desktop-users/