the method detects and identifies the skeleton, the hand area and fingertips that expresses the hand states (open/closed), and different motion functions using hand gestures
Action identification System
describes the way to get instruction, modification of size and location, and explains how to perform the gestural action without touching any device
1. Skeleton information using kinect sensor
The location of the both hands can be determined from the skeleton information which is correlative with the shoulders and head of the user.
2. Dynamic hand state & gesture recognition
dynamic hand gesture recognition ⇒ challenging
: If a person continuously waves his hand in front of Kinect device like following figure and machine can understand the direction one by one at a certain time
3. Hand area and movement detection
After confirming the size and location of the user, he/she can perform the Motion-Functions.
=> To perform those functions, the distance between different positions of the skeleton are measured using the Euclidean distance by Equation.
divide system into two parts
1. Skeleton information using kinect sensor
The location of the both hands can be determined from the skeleton information which is correlative with the shoulders and head of the user.
2. Dynamic hand state & gesture recognition
dynamic hand gesture recognition ⇒ challenging : If a person continuously waves his hand in front of Kinect device like following figure and machine can understand the direction one by one at a certain time
3. Hand area and movement detection
After confirming the size and location of the user, he/she can perform the Motion-Functions. => To perform those functions, the distance between different positions of the skeleton are measured using the Euclidean distance by Equation.