ahollenbach / GesturalMusic

Making music with the body, using the Kinect 2.
MIT License
10 stars 5 forks source link

Make projection 3D aware #18

Closed ahollenbach closed 1 year ago

ahollenbach commented 2 years ago

Creating this draft PR for documentation purposes.

This PR changes overhauls how the "floor" is managed from a 2D world to a 3D world. This provides tooling to help calibrate the floor so that the projection can have things like text written on it without being skewed.

This is demonstrated by showing a looping UI in each of the quads to help the musician better understand the state of the instrument (previously, it was "guess which state you think it's in and hope!").

This also opens the gate to more intuitive interaction - ie stomp on this circle on the floor to start looping, instead of having to learn a new "language" of looping signals (foot tapping alongside hand gestures).