Android Wake Word

[secretsauceai]

In order for the wake word to work on Android we need:

• Write the inference using TF Lite.
  • There's already some code for processing this in Rust Precise RS.
• Perform MFCC
  • The code above already implements MFCC, however the standard Rust library was TOO slow (like 10 times too slow), therefore a new implementation is required. See SpeechPy MFCC Rust
• Capturing sound.
  • If using Rust Cpal can be used
• Write an Android service
  • https://developer.android.com/training/articles/assistant.html
  • https://android.googlesource.com/platform/frameworks/base/+/marshmallow-release/tests/VoiceInteraction/
  • Seems like the real star of the show is the permission "android.permission.BIND_VOICE_INTERACTION".

[hobbycommandline]

Unless I read wrong that permission goes through voice interaction service and thus would make only the system Digital Assistant able to use it, eventually ending up in the private AlwaysOnHotwordDetector https://stackoverflow.com/questions/26834163/example-of-alwaysonhotworddetector-in-android hot words should be accessible to user space applications, with permissions set by the user in a config panel, not reserved by the system.

[Tadashi-Hikari]

I already have the code for some of this written up. I've done the Android BIND_VOICE_INTERACTION and had the app show as an available Voice Assistant/Voice recording application.

I'm happy to walk some people through the code.