Add sonification - Githubissues

DamienLB / accessudemo2020

0 stars 0 forks source link

Add sonification #2

Open DamienLB opened 4 years ago

DamienLB commented 4 years ago

add sonification so that sound changes as it nears object (by increasing pitch or tempo)

DamienLB commented 4 years ago

@kelly-lancaster here's a test link: https://accessu2020.us-east-1.linodeobjects.com/refs/pull/5/merge/index.html

kelly-lancaster commented 4 years ago

@DamienLB thanks! the sonification works well but is a bit grating (cheese joke!) to listen to...

can we add a toggle to switch sonification on/off (not sure if it should be on or off by default... thoughts?)
instead of playing a continuous sound while an object is being moved, can we just play a short audio clip when the object changes position? are all of the objects using the same sound? would it be possible to use free audio clips for each object? for example: -- mouse: https://freesound.org/people/Higgs01/sounds/428114/ -- cat: https://freesound.org/people/Reitanna/sounds/343927/ -- cheese: https://freesound.org/people/Streety/sounds/30244/

DamienLB commented 4 years ago

@kelly-lancaster

yes! definitely can add a switch to toggle the sounds.
I need to check how to change the frequency of pre-recorded sounds, but I'm sure it could be done.
As far as not making the sound continuous, I can make it more of a staccato series of sounds as an item is dragged, if that's what you mean. As it is, the sound should stop when you drop the item - that's the behavior you currently see, correct?

kelly-lancaster commented 4 years ago

@DamienLB

Re: continuous sound, I was using keys to move the objects around - after pressing a key, the sound continues until you press the space key to drop the object. The sound effects are not quite as annoying when you are using a mouse to move the objects around!

DamienLB commented 4 years ago

https://accessu2020.us-east-1.linodeobjects.com/issue2-sonification/index.html

kelly-lancaster commented 4 years ago

Let's have the sound be OFF by default. And make sure to associate the toggle with the label, probably using aria.