IntelRealSense / librealsense

Intel® RealSense™ SDK
https://www.intelrealsense.com/
Apache License 2.0
7.6k stars 4.83k forks source link

Is there a way to recognize a person and determine where he or she has a joint? #5031

Closed devLupin closed 5 years ago

devLupin commented 5 years ago

Required Info
Camera Model D435
Firmware Version 05.11.06.250
Operating System & Version Win10
Kernel Version (Linux Only) (e.g. 4.14.13)
Platform PC
SDK Version Latest
Language C++/C#
Segment others

Issue Description

I want to get the angle of a specific joint through image processing. I tried with Kinect sensor but this time I want to do it with RealSense. My first thought process is as follows: 1. Recognize people through image processing 2. Judge the points of each joint and calculate the three points of the joint to get the angle. * I don't know how to determine if I am a person through image processing and find out where his joints are. Can you please tell me something? Is there a recommendation method or API? Is there anything I can refer to? Thank you for your answer.
MartyG-RealSense commented 5 years ago

The best software available for joint tracking with a 400 Series camera is a commercial package called Nuitrack SDK. It has a licence fee of $40 a year but has a free trial version.

https://nuitrack.com/

The link below suggests a method for calculating joint angle with Nuitrack.

https://community.nuitrack.com/t/calculate-the-angle-between-two-joints/1121

devLupin commented 5 years ago

@MartyG-RealSense

I searched and found it was compatible with the D435. Thank you very much. You are my job saver(?).

MartyG-RealSense commented 5 years ago

Yes, it works fine with D435. I'm glad I could be of help :)