search

microsoft / Azure-Kinect-Sensor-SDK

A cross platform (Linux and Windows) user mode SDK to read data from your Azure Kinect device.
https://Azure.com/Kinect
MIT License
1.49k stars 620 forks source link

Request for Evaluation Metrics on Body Tracking SDK #1087

Open fishbotics opened 4 years ago

fishbotics commented 4 years ago

Hi all,

This is a cross post from the official development forum because I figure people on Github may also be interested in this.

I've been using the Body Tracking SDK for research in human motion prediction. In our research, we measure the accuracy of our predictions against the measurements from the SDK. However, we don't know the typical accuracy we can expect from the the body tracker. Does the development team have metrics comparing the body tracker to some sort of ground truth (maybe a mocap system)? This would be very helpful in understanding what confidence we should assign to the estimates coming from the tracker.

Thanks!

Describe the solution you'd like Some publicly-accessible (and citeable) metrics indicating how accurate the tracker is.

Describe alternatives you've considered Calibrating a mocap system to the tracker and running the evaluation in a limited setting. I think it would be better to publicize a general set of metrics for the body tracker.

Additional context Here is the issue on the official forum

qm13 commented 4 years ago

We are reviewing how best to publish some key performance indicators.