Add voice input to dnd - Githubissues

DamienLB / accessudemo2020

0 stars 0 forks source link

Open DamienLB opened 4 years ago

DamienLB commented 4 years ago

Voice input should identify object and move it up, down, left, right OR to an object itself.

kelly-lancaster commented 4 years ago

Add a toggle to turn voice input ON, pre-train commands to move mouse only (other objects are extra credit)

DamienLB commented 4 years ago

kelly-lancaster commented 4 years ago

Notes from call:

Test link only works in Chrome & Edge (it does not load in FF or Safari) because of audio recognition tool being used - it's not using machine learning currently
Combine some of the voice commands (e.g., 'select' and 'pick up')
Add a readout of what is being heard by the audio recognition