Get color from color space with depth space coordinate.

alekhinen / Capstone

helios: an interactive audio-visual experience.

3 stars 1 forks source link

Get color from color space with depth space coordinate. #2

Closed alekhinen closed 7 years ago

alekhinen commented 7 years ago

We get our skeletons from getDepthSkeleton(). How do we change the joint coordinates from depth space to color space so we can get the user's colors in that specific joint coordinate.

Some options are to use getColorSkeleton() to get the joint color coordinates, however this can't be active at the same time as getDepthSkeleton(). So ideally we need to map depth coords to color coords.

alekhinen commented 7 years ago

Solution (for now) https://github.com/alekhinen/capstone/pull/4:

Use getColorSkeleton() to allow us to get the average color values at all the joints.
Get the pseudo-depth value by mapping the joint position from HD Color to the depth space. This is definitely offset slightly, but for our purposes we don't need something exact in the MVP.