sign / translate

Effortless Real-Time Sign Language Translation
https://sign.mt
Other
436 stars 77 forks source link

Question/long term goal: automatic integration in YouTube videos #112

Closed vpicouet closed 7 months ago

vpicouet commented 11 months ago

Problem

No response

Description

Hello, Very interesting/impressive work with amazing potential!!! How long do you think it could take to potentially have the possibility to have your sign language videos generated automatically (by Google, for example) and integrated directly into YouTube videos (on which subtitles are already generated automatically)? 5/10/20+ years? Is it something you already had in mind and have been discussing (with YouTube/Vimeo or other platforms)? What do you see as the main challenges for getting there?

Alternatives

No response

Additional context

No response

AmitMY commented 11 months ago

We worked on something similar - an addon to YouTube to overlay the video: https://www.youtube.com/watch?v=U9cIoQGm1cw

The problem is not the integration, but the translation quality. I believe that, given investment money and human resources (developers, researchers) it will take a few months to worst-case scenario two years until the system is usable and generates good, viable translations. It is a problem both of research and of lack of data.