sign / translate

Effortless Real-Time Sign Language Translation
https://sign.mt
Other
414 stars 74 forks source link

Need more Resources #123

Closed bipinkrish closed 7 months ago

bipinkrish commented 7 months ago

Description

I want to test this model with Python, when tried to convert with tensorflowjs_converter i encountered this issue

Can I get one of these

AmitMY commented 7 months ago

Seems like you are trying to convert the face model. Training code in python https://colab.research.google.com/drive/1io4XM11EpYi3HNadABhDZYBjPdvZrFcd?usp=sharing

Full explanation of what is done here: https://youtu.be/bwCNLiksILU?t=126

Note, that only this face features were trained on (no asymetric features) image

Feel free to improve the model, and I'd be happy to include it in the app :)

bipinkrish commented 7 months ago

Training code in python colab.research.google.com/drive/1io4XM11EpYi3HNadABhDZYBjPdvZrFcd?usp=sharing

Thank you.

can I also get code for hand, detection and pose model? It would be really helpful if you share everything you have related to this project

AmitMY commented 7 months ago

Please see https://www.youtube.com/@AmitMoryossef/videos and the description for every video for the relevant model code. Also note that some models have a README https://github.com/sign/translate/tree/master/src/assets/models/hand-shape

bipinkrish commented 7 months ago

youtube.com/@AmitMoryossef/videos

I did find for hand-model but I did not find video about pose-animation and detection-code is not available

AmitMY commented 7 months ago

Detection is here https://github.com/sign-language-processing/detection-train Animation is still actively being worked on, here https://github.com/sign-language-processing/pose-to-video/tree/main/pose_to_video/unconditional/mixamo (based on https://www.youtube.com/watch?v=TyJuU9_GOaw)

bipinkrish commented 7 months ago

Thank you