This repo contains the source code for MobileHand, real-time estimation of 3D hand shape and pose from a single color image running at over 110 Hz on a GPU or 75 Hz on a CPU.
If you find MobileHand useful for your work, please consider citing
@inproceedings{MobileHand:2020,
title = {MobileHand: Real-time 3D Hand Shape and Pose Estimation from Color Image},
author = {Guan Ming, Lim and Prayook, Jatesiktat and Wei Tech, Ang},
booktitle = {27th International Conference on Neural Information Processing (ICONIP)},
year = {2020}
}
The simplest way to run our implementation is to use anaconda and create an environment called mobilehand
conda env create -f environment.yaml
conda activate mobilehand
Next, download MANO right hand model
mano_v1_2.zip
)mano_v1_2/models/MANO_RIGHT.pkl
into the mobilehand/model
foldercd code/ # Change directory to the folder `mobilehand/code/`
python demo.py -m image -d stb # Test on sample image (STB dataset)
python demo.py -m image -d freihand # Test on sample image (FreiHAND dataset)
python demo.py -m video # Test on sample video
python demo.py -m camera # Test with webcam
python demo.py -m camera -c # Add -c to enable GPU processing
Jiawei Zhang, Jianbo Jiao, Mingliang Chen, Liangqiong Qu, Xiaobin Xu, and Qingxiong Yang
Christian Zimmermann, Duygu Ceylan, Jimei Yang, Bryan Russell, Max Argus, Thomas Brox
Seungryul Baek, Kwang In Kim, Tae-Kyun Kim
Adnane Boukhayma, Rodrigo de Bem, Philip H.S. Torr
Liuhao Ge, Zhou Ren, Yuncheng Li, Zehao Xue, Yingying Wang, Jianfei Cai, Junsong Yuan
Yana Hasson, Gül Varol, Dimitris Tzionas, Igor Kalevatykh, Michael J. Black, Ivan Laptev, and Cordelia Schmid
Xiong Zhang*, Qiang Li*, Wenbo Zhang, Wen Zheng
Dominik Kulon, Riza Alp Güler, Iasonas Kokkinos, Michael Bronstein, Stefanos Zafeiriou
Yuxiao Zhou, Marc Habermann, Weipeng Xu, Ikhsanul Habibie, Christian Theobalt, Feng Xu
Filippos Gouidis, Paschalis Panteleris, Iason Oikonomidis, Antonis Argyros
Angjoo Kanazawa, Michael J Black, David W. Jacobs, Jitendra Malik
Javier Romero, Dimitrios Tzionas, Michael J Black