search

waynshang / Gesture-Recognition-with-3DCNN

Gesture recognitino with 3DCNN
27 stars 16 forks source link

readme

Gesture-Recognition-with-3DCNN

In this repo I will provide 3 different way to do gesture recognition

References Link:

  1. https://research.nvidia.com/sites/default/files/pubs/2015-06_Hand-Gesture-Recognition/CVPRW2015-3DCNN.pdf
  2. https://arxiv.org/pdf/1412.0767.pdf
  3. http://papers.nips.cc/paper/7465-attention-in-convolutional-lstm-for-gesture-recognition.pdf

I select 6 different gestures from jester dataset
Include swiping left, swiping right, no gesture, rolling forward, rolling backward, stop

First model:LRN+HRN can reach 0.78 accuracies image
Second model: 3DCNN can reach 0.76 accuracies
image
Third model: 3DCNN+ one layer LSTM / + two layer LSTM / + three layer LSTM
image
image
image

You can directly type in follwing command on your terminal to execute real-time demo

python real_time/real_time.py

result

image

Link

I also post a video on youtube:
https://www.youtube.com/watch?v=vd0czNKL1DE
Feel free to contact me on linkdein:
https://www.linkedin.com/in/wayne-shang-909636166/