sign-language-processing / spoken-to-signed-translation

a text-to-gloss-to-pose-to-video pipeline for spoken to signed language translation
https://sign.mt/?sil=sgg&spl=de
MIT License
40 stars 10 forks source link

Release of gsg and bfi models? #33

Closed Tortoise17 closed 3 months ago

Tortoise17 commented 3 months ago

When will be gsg and bfi models expected to get released? If there is any information already?

AmitMY commented 3 months ago

To get bfi and gsg working, one needs to update the download_lexicon.py file to support wordnet. There is a data loader one can use here but it might require some minor adjustments for the latest version of the wordnet.

I do not personally intend to add this to the repository, but if you wish, I will gladly review PRs. (should not be more than 2-3 work hours)

Tortoise17 commented 3 months ago

Just as quick question, is there any Spanish also available or multi-lingual model works for most of EU/Global languages ?

AmitMY commented 3 months ago

To get any language working with this repository, you just need a lexicon of the relevant language. If you take a Spanish lexicon, it will work, etc. Wordnet has 8 languages.