search

KilleenCode / brancato

A cross-platform omnibar to to easily run workflows, built in Rust 🦀
MIT License
5 stars 2 forks source link

Request: add speech recognition #54

Closed RyKilleen closed 2 years ago

RyKilleen commented 2 years ago

Is your feature request related to a problem? Please describe. Sometimes speech is faster than text, or your hands are occupied.

Describe the solution you'd like It'd be great to use the Web Speech API to quickly select a workflow or other omnibar option, with a confirmation step. A speech pattern of "[search term]." <pause> "Confirm" or "[section][item]" <pause> "Confirm" would work great. eg:

"Finances. Confirm." "workflow:finances. Confirm"

This can and should be configurable from the settings page, to disable. Using the Web Speech API means no external service is needed. If enabled. the browser will request access on first run. This might be awkward for the Omnibar, so maybe it's off by default and the browser access request happens on the settings page.

Additional context Would love to make this as multi-lingual as possible out of the gate. I believe using the browser's default lang, not prescribing search terms, and expanding the language support for default search terms like Settings puts it right on the mark.

For example, if

The Speech to text search should work as expected

RyKilleen commented 2 years ago

Dreams are dashed here atm, right now WebView2 doesn't support Web Speech Recognition API (support is very limited, to mostly just chrome.)

Any other direction ends up requiring a cloud service and that's not in the scope atm. Will re-open if and when it's time.