search

PoseAI / PoseCameraAPI

Tools to work with the Pose Camera app
Apache License 2.0
146 stars 38 forks source link

Finger tracking issues with PoseAI and Action Figures #8

Closed HeadClot closed 2 years ago

HeadClot commented 2 years ago

Hey - I am having an issues with finger tracking. To give some context I am using an Drawing Reference Action figure from Amazon. You can see the results below. As you can see the fists are not clenched but are straight. Is there any way to correct this?

image image

PoseAI commented 2 years ago

Hi, so are you aiming the iPhone camera at a picture (ie the anime cartoon you posted)? 1. The hands need a very good resolution base image: ideally just the hands should be fill around 200 pixels square. So if using non live stream make sure resolution is high.

  1. The AI is trained mostly on ungloved hands as our assumption is a user filming themselves is not wearing gloves inside.
  2. A cartoon hand is not the same as a human hand so accuracy may suffer versus real images.

and just to confirm, you are using a mode with hands (not say RoomBodyOnly)

PoseAI commented 2 years ago

Hi, I see you were actually using a small figure as your reference model. That is not really an optimal subject - you will do better using photos of posed models if you want to use reference material. As we haven't heard anything back we will close the issue. Cheers