sign / translate

Effortless Real-Time Sign Language Translation
https://sign.mt
Other
414 stars 74 forks source link

[Feature] Donate a sign #145

Open AmitMY opened 5 months ago

AmitMY commented 5 months ago

Problem

We have no mechanism for users to provide direct feedback on wrong translations.

Description

When translating from a sign language video to spoken language text, when uploading a video, we translate into spoken language. The translation is likely to be wrong, at the moment, in most languages, in most scenarios.

Let's assume the translation here is wrong:

image

There should be a button on the output side, perhaps on the right side, named "Donate a sign" , like this

image

This button asks the user if they have the rights to the video, and if so, allows the user to suggest an alternative translation, and uploads the video to sign.mt's SignTube account with the suggested caption. If the data was donated, the button can change to: image - maybe even linking to the SignTube video.

We then can train on this new video etc...

When the user suggests an edit, it shows:

image

Alternatives

Google Translate has a different solution:

image

Additional context

Possibly generalize this to allow donations in the spoken-to-signed direction as well, but that has more variation.