search

opendr-eu / opendr

A modular, open and non-proprietary toolkit for core robotic functionalities by harnessing deep learning
Apache License 2.0
614 stars 95 forks source link

Add RGB gesture recognition #436

Closed katerynaCh closed 1 year ago

katerynaCh commented 1 year ago

This PR implements RGB-based hands gesture recognition (detection) based on hagrid dataset for 18 hand gestures.

We currently provide one pretrained model. ROS1/ROS2 nodes are included, as well as a webcam demo.

Algorithmically it relies on existing implementation of nanodet (I thought it is better from application perspective to create a dedicated learner for gesture recognition, but please let me know if you think otherwise and I change it, and just provide necessary model/dataset processing/configs as part of nanodet learner).

katerynaCh commented 1 year ago

I didn't had time to test the examples yet, but here are some initial comments. I'm also trying to fix the test suite on the master/develop branches so that we could then run the tests in this branch.

Thank you! I have incorporated the changes.

tsampazk commented 1 year ago

Hey @katerynaCh, thank you for the new tool. I will do a thorough review soon. Taking a quick look, i noticed that doc entries for the ROS1/2 nodes seem to be missing. In the meantime, could you please add entries in the index lists here (ros1) and here (ros2) that link to corresponding sections here and here?

Let me know if you have any issues i can assist with!

katerynaCh commented 1 year ago

Thank you @tsampazk @stefaniapedrazzi !