sign / translate

Effortless Real-Time Sign Language Translation
https://sign.mt
Other
436 stars 77 forks source link

[Feature] Spoken-to-signed Endpoint #95

Closed AmitMY closed 10 months ago

AmitMY commented 1 year ago

Problem

Currently, the endpoint is hosted on Bar-Ilan University servers, and is not easy to modify

Description

We should make a python cloud function that calls: https://github.com/ZurichNLP/spoken-to-signed-translation

Inputs:

Process:

Outputs:

AmitMY commented 10 months ago

Done in a closed source deployment, available at: https://us-central1-sign-mt.cloudfunctions.net/spoken_text_to_signed_pose

bipinkrish commented 7 months ago

Done in a closed source deployment

is there a plan to make it open source

MuhammadAasharibNawshad commented 7 months ago

Is the code for this url available somewhere? https://us-central1-sign-mt.cloudfunctions.net/spoken_text_to_signed_pose. I donot want to change the method and use it unchanged.

AmitMY commented 7 months ago

This repository is open source https://github.com/ZurichNLP/spoken-to-signed-translation The endpoint is closed-source since it directly accesses a different pose dataset, but then all it does is call the library and nothing else.

MuhammadAasharibNawshad commented 7 months ago

So my understanding for https://us-central1-sign-mt.cloudfunctions.net/spoken_text_to_signed_pose is that it basically has different lexical for different languages. And whenever the API is called, it returns pose for that particular spoken to sign language lexical. Can you please tell whether my understanding regarding this Endpoint is correct or not?

AmitMY commented 7 months ago

There are many lexicons, for many signed languages. whenever the endpoint is hit, it takes signs from that specific lexicon, and stitches them. This is the same as done in the open source implementation, just that it uses an SQL database instead of a CSV file