audio—develop speech to text control feature for demo

[ludimation]

[ to do ]

• implement this feature—will use stand-alone STT for now
  • develop logic for identifying content of "about" messages
  • respond to messages
• create blue-mix version of this bug (for far future)

[ desired behavior ] in order of priority

• show information for any node by name (new functionality from issue #26 )
  • voice command "Please tell me about [x]" = OSC message "about [x]", Where [x] is the remainder of the STT transcript
• advance narrative (similar to space key input)
  • voice command "Please continue" = OSC message "continue"
• begin demo (similar to enter key input)
  • voice command "start" = OSC "start" — might want to change to "let's begin" or something harder to accidentally trigger in a demo
• narrate forward / back in journal (left + right arrows)
  • forward voice command "next" = OSC "next" — might want to change to something harder to accidentally trigger in a demo *back voice command ? = OSC ?
• hide non-journal / narrative node information (new functionality from issue #26 )
  • voice command ? = OSC ?

[ludimation]

[ done ]

• meet with Jonas, Sam, Zev, Gordon, Craig, et al (audio input on CISL 03)
• list previous behavior—current Unity implementation has never supported STT input
• investigate the use of the Boston demo technology to call functions below—out of scope for this milestone

[ludimation]

[ done ] * send messages to Unity * decide on keywords / create list to respond to * receive messages in Unity