ahollenbach / GesturalMusic

Making music with the body, using the Kinect 2.
MIT License
10 stars 5 forks source link

List of gestures that trigger sound #6

Closed ahollenbach closed 10 years ago

ahollenbach commented 10 years ago

Essentially, we need what gestures you want and what the that gesture would trigger. From basic gestures and their triggers to those "I don't even know if this is possible but let's try it" gesture/trigger combinations. This will give us a better idea of what needs to be done in order to make these gesture/trigger combos function, and a better understanding of the project overall.

List, in as much detail as possible. Please and thank you.

ahollenbach commented 10 years ago

@mcoxvla:

0 - MIDI Pitched instrument/“soprano”

RightHand RH open below mid point, sends noteOn message to Ableton RH open above mid point, sends noteOff message to Ableton (I like the idea of tapping a hot stove or touching the keys on the piano) RH below mid point, x y & z directions all map to different filter envelopes It’d be cool if the effect ended up looking like stirring a pot of funky sounds LeftHand Pitch - (x-axis/body relative) Open palm - white piano keys (c, d, e, f, g, a, b) Fist - black piano keys (c#, eb, f#, g#, bb) 3 octaves? Volume - pointer/middle finger (y-axix, relative to mid point/OR point that feels comfortable? how customizable is that?)

1 - BEATS

RightHand RH open below mid point, sends message to activate drum visually like hitting a literal drum LeftHand Toggles between drum instruments? (Kick, hi hat, snare, etc) I would LOVE IT if this could be a LeftHand punch to the side, or maybe a swing of the left arm?

2 - BASS MIDI Pitched instrument

Same controls as the 0 quadrant, but using a different instrument track in Ableton

3 GRANULATOR

This is my greatest dream: https://www.ableton.com/en/packs/granulator/ It takes little bits of a recorded sound and loops the group of samples according to a window you can customize. ITS SO COOL AND THERE’S SO MUCH AWESOME STUFF that we can look at but here’s what I’m thinking right now: RightHand Open left/right(body relative) file position -changes the window position in the wave form that is being manipulated Open up/down filters/frequencies to modulate LeftHand Open hand right to left (body relative) sets window size (closed hand stops window change) changes the number of grains/samples that are looped

ahollenbach commented 10 years ago

There is now a live document of gestures found here