search

brilliantlabsAR / noa-for-ios

You AI companion. ChatGPT and translation for Monocle AR
ISC License
70 stars 14 forks source link

[feature request] Add a mode to simply echo the text heard to the display #98

Open josuah opened 4 months ago

josuah commented 4 months ago

This can make the Noa backed devices as a simple "hearing glass" that allows to read the text spoken out loud for hard of hearing or deaf communities.

It also doubles as a way for end-users to troubleshoot what was received by Noa.

josuah commented 3 months ago

This could also be used and extended as a translation feature.

The app would need modification to show the translated query, without trying to fetch a response instead.

(requested by email)

lukeswitz commented 2 months ago

This is incredibly simple. Apple Speech can do a great job parsing speech to text. It eliminates the need to make the initial call to the OpenAI API and can also do nearly live translation and captioning.

Surprised this isn’t in the codebase yet. I can open a PR to get it going if interested

josuah commented 2 months ago

You might be interested to wait that the rewrite of Noa comes, as it will likely use a different framework supported by both Android and iOS.

And then, after this, all it takes might be a pull request, as you said!