audio—develop speech to text control feature for demo

ludimation commented 8 years ago

[ to do ]

implement this feature—will use stand-alone STT for now
- develop logic for identifying content of "about" messages
- respond to messages
create blue-mix version of this bug (for far future)

[ desired behavior ] in order of priority

show information for any node by name (new functionality from issue #26 )
- voice command "Please tell me about [x]" = OSC message "about [x]", Where [x] is the remainder of the STT transcript
advance narrative (similar to space key input)
- voice command "Please continue" = OSC message "continue"
begin demo (similar to enter key input)
- voice command "start" = OSC "start" — might want to change to "let's begin" or something harder to accidentally trigger in a demo
narrate forward / back in journal (left + right arrows)
- forward voice command "next" = OSC "next" — might want to change to something harder to accidentally trigger in a demo *back voice command ? = OSC ?
hide non-journal / narrative node information (new functionality from issue #26 )
- voice command ? = OSC ?

ludimation commented 8 years ago

[ done ]

meet with Jonas, Sam, Zev, Gordon, Craig, et al (audio input on CISL 03)
list previous behavior—current Unity implementation has never supported STT input
investigate the use of the Boston demo technology to call functions below—out of scope for this milestone

ludimation commented 8 years ago

[ done ] * send messages to Unity * decide on keywords / create list to respond to * receive messages in Unity

pcioni / CISL