search

enghock1 / Real-Time-2D-and-3D-Hand-Pose-Estimation

Real-Time 2D and 3D Hand Pose Estimation from RGB Image
GNU General Public License v2.0
48 stars 15 forks source link

dual hand estimation #4

Closed lisa676 closed 4 years ago

lisa676 commented 4 years ago

Thanks for this meaningful repository. I have a question that how it can work with left and right hand at same time? Do we need additional training on other datasets for this step? Need your suggestions about it. Thanks

enghock1 commented 4 years ago

Hi there, this model would not work on both hands at the same time, but you can apply some tricks to make it work (sort of). One way I can think of, for non-interacting hand case, is to have a simple ML model to identify and crop the hands before passing them to the hand pose estimation model, then project the estimated hand skeletons back to the original image. Obviously, this trick would not work for the interacting hand case, and you might need a new dataset with both hands and a new DL architecture to make it work.