search

jitsi / jitsi-meet

Jitsi Meet - Secure, Simple and Scalable Video Conferences that you use as a standalone app or embed in your web application.
https://jitsi.org/meet
Apache License 2.0
22.98k stars 6.69k forks source link

Feature Request for Educators and Language Teachers #7151

Closed inglesuniversal closed 4 years ago

inglesuniversal commented 4 years ago

Please add automatic subtitles to live video conference as current user speaks.

and two language subtitles in two custom colors would be even better. One row in English and one row in Spanish (as an example)

Check: meet.google.com

darthvader2 commented 4 years ago

i will try to do it.

anybody already working on it ?

Echolon commented 4 years ago

@darthvader2 please check previous GSoC project first.

Echolon commented 4 years ago

@inglesuniversal can you please provide a proper title and fill the issue template?

inglesuniversal commented 4 years ago

Do I have to open a new issue for that or have a sample template available? I've never done it like that. I'm eager to help in any way possible. Thanks and STAY SAFE!!!

jhiswin commented 4 years ago

Relevant: https://nikvaessen.github.io/jekyll/update/2017/08/24/gsoc2017_work_product_submission.html

@Echolon I haven't looked deeply into it, but it looks like most of the work is already merged into Jitsi main itself? Does that mean it's really just a matter of enabling it (and having the sip gateway set up)?

I'd be interested in modifying it for use with Azure or AWS transcription APIs, especially if the groundwork is already there.

inglesuniversal commented 4 years ago

As an English as a Second Language certified instructor for the past 23 years. I must add that I tried meet.google.com this evening and the captioning worked really well and it dramatically improved the teaching experience online. But as anything new, it has big flaws. You cannot turn the captions on or off easily, chrome starts jiggling the windows sizes as you move the mouse around, if I start speaking into my native language (Spanish) the words get mixed into the subtitles messing up the structure of the sentence I said in English. It would be amazingly better to split the translation into different lines and custom colors as each participant speaks or switches to another language. If I can further help you improve this you can count on me. I am a big fan of your project. Best regards

jhiswin commented 4 years ago

@inglesuniversal After taking more of a look into it, it looks like everything you need for transcription features is already merged into the mainline repos.
https://github.com/jitsi/jigasi#configuring-sip-and-transcription

There's a repo with full deployment installer here: https://github.com/switnet-ltd/quick-jibri-installer

Main installation script for the Jigasi transcription portion: https://github.com/switnet-ltd/quick-jibri-installer/blob/master/jigasi.sh

I'm not sure about the chances of this making it onto meet.jit.si though, if that's what you're hoping for. Costs would probably be prohibitively high. And I don't see any way to connect it to your own self-hosted Jigasi.

stale[bot] commented 4 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

kkarhan commented 6 months ago

Seriously stalebot is value-removing and as @inglesuniversal hinted, closed-captions & subtitles are quite essential.

So please add this essential accessibility feature if it isn't there already...

It's also not listed on the website so I assume it's not there.

saghul commented 6 months ago

Subtitles have been available for years now. I guess you didn't even bother checking eh?