robotology / assistive-rehab

Assistive and Rehabilitative Robotics
https://robotology.github.io/assistive-rehab/doc/mkdocs/site
BSD 3-Clause "New" or "Revised" License
21 stars 11 forks source link

Detect raised hand using 3D skeleton #246

Closed vvasco closed 4 years ago

vvasco commented 4 years ago

From the latest tests I've been doing on the robot, it turned out that for high distances robot-user (~3m), humanStructure flickers in detecting that the hand is lifted. This occurs as the threshold applied to the distance elbow-wrist does not scale up with the depth and leads to a continuous flickering of start and stop commands, sent to googleSpeech. Using 3D skeletons, rather than 2D, should provide us with a more robust detection. managerTUG can directly deal with this.

cc @vtikha @pattacini

vvasco commented 4 years ago

The following compares the output of humanStructure and managerTUG when using 2D and 3D skeleton respectively:

2D skeleton 3D skeleton

In total the hand is raised 4 times, so 4 couples of Starting speech / Stopping speech messages should be printed: