We get our skeletons from getDepthSkeleton(). How do we change the joint coordinates from depth space to color space so we can get the user's colors in that specific joint coordinate.
Some options are to use getColorSkeleton() to get the joint color coordinates, however this can't be active at the same time as getDepthSkeleton(). So ideally we need to map depth coords to color coords.
Use getColorSkeleton() to allow us to get the average color values at all the joints.
Get the pseudo-depth value by mapping the joint position from HD Color to the depth space. This is definitely offset slightly, but for our purposes we don't need something exact in the MVP.
We get our skeletons from
getDepthSkeleton()
. How do we change the joint coordinates from depth space to color space so we can get the user's colors in that specific joint coordinate.Some options are to use
getColorSkeleton()
to get the joint color coordinates, however this can't be active at the same time asgetDepthSkeleton()
. So ideally we need to map depth coords to color coords.