sign / translate

Effortless Real-Time Sign Language Translation
https://sign.mt
Other
436 stars 77 forks source link

[Feature] Pose-Viewer - add 2D Avatar Pose Viewer #68

Open AmitMY opened 1 year ago

AmitMY commented 1 year ago

Problem

The 3D avatar solution is not great. Even if it was great, it is not really guaranteed to work for any possible pose.

The skeleton viewer is quite ugly.

The 3D avatar requires 25MB of download, and the photo realistic avatar requires a larger download, plus is very slow and requires a GPU.

Description

In addition to the SkeletonPoseViewer, AvatarPoseViewer, and HumanPoseViewer, support an 2DAvatarPoseViewer.

It should be based on https://github.com/yemount/pose-animator And allow for settings under Appearance for male/female/others

Alternatives

Only rely on the 3D avatar or photo-realistic avatar.

Additional context

Main issue with this approach: Hands have more degrees of freedom than other parts of the body. It is possible that they would look really really bad. Perhaps investigate a solution with multiple types of hands, to be selected in real-time (for example, front vs back)