Sign-by-Word Translation Improvements - Githubissues

sign / translate

Effortless Real-Time Sign Language Translation

https://sign.mt

Other

489 stars 83 forks source link

Sign-by-Word Translation Improvements #17

Closed AmitMY closed 2 years ago

AmitMY commented 3 years ago

URL parameters:

[x] slang (spoken language - en, fr, he, etc..)
[x] dlang (signed language - us, gb, fr, il, etc...)
- [ ] special case - when given cn, use fl
[x] sentence
[x] fps (optional, when given, interpolate the final pose to this fps)

Translation functionality:

[x] allow translation from any slang to any dlang. Search terms by slang, find videos by dlang.
[x] translation of a single word should not crash
[x] translation of an unknown latin word when dlang=us should be fingerspelled
[x] translation of a sentence containing an unknown word when dlang!=us should skip the word.

Bugs

[ ] Dictionary words are broken in half - cannot becomes "can" + "not" (which is a "can" - "פחית")
[x] The first and second signs never interpolate. Type "1 2 3" and there is no interpolation between "1" and "2".

https://user-images.githubusercontent.com/5757359/130967017-3520b6b7-81f5-4d12-a342-56d061e329ad.mp4

Type "testing 1 2 3" and now there is between "1" and "2" but not between "testing" and "1"

https://user-images.githubusercontent.com/5757359/130967026-084d89de-0496-43a3-b3b8-061d4bc8226b.mp4