Add Apple Watch integration

[danielsuo]

This may be a little tricky because there are a few ways to do this:

• Siri integration
• Watch complication
• Watch App

Siri integration is already on the docket (#263). It's not clear how a complication or app would work; I'm pretty sure we don't want users entering text, so is it audio (#245)? Voice to text? If audio, how long can the note be? How do we handle previews? Etc etc.

[danielsuo]

From forum discussion

As for the Apple Watch app, the ideal situation would be to have Noto send me an email with an audio clip of the voice note and a transcription of the voice note in the body of the email. This is how Android's "note to self" command works - I absolutely loved this feature when I had an Android phone many years ago. This way, I could read the transcription of the voice note, but if the transcription is inaccurate, I could always listen to the audio clip. From speaking with different developers, it is my understanding that this is not possible due to iPhone's system limitations (indeed, the "note to self" command on Google Assistant for iPhone only transcribes the audio into the body of an email - it does not attach an audio clip to the email like the Android version). I'm not sure if you have a solution to this issue.

If it's indeed not possible, my preference is for an audio clip to be attached to an email as opposed to a transcription of the voice note in the body of the email because often times the transcription is inaccurate.

Siri integration would be great, but an Apple Watch complication would be much more convenient. It should be a two touch process to begin recording a voice note (since I often accidentally press complications on my Apple Watch). This is how the "Email Me" Apple Watch app works.

[danielsuo]

Communicating between watch iOS and react native on phone

https://github.com/mtford90/react-native-watch-connectivity

[danielsuo]

Part 1: One possible plan of attack:

• Add other attachment types (see issue), starting with audio for the main app
• Add a watch complication for recording and sending (frankly, would probably add share extension first since that might be a more common use case and the on-device app infrastructure would be very similar to the watch use case)
• Migrate email logic from React Native to iOS (otherwise, watch will have to be tethered to phone)

Part 2: Transcribing is completely doable, but gets more complex:

• Send audio to some service (e.g., Google Cloud Speech API, which costs $0.006 seconds per 15 seconds of audio above the first 60 minutes per month)
• Wait for the result and only send the note when we get the result back

Of course, this isn't a very natural way to transcribe (typically would have some backend server), but Noto is device-only for simplicity and privacy. Would probably also need to think about some sort of Noto subscription model (ew) to cover variable costs.

[danielsuo]

https://developer.apple.com/documentation/speech

[danielsuo]

https://github.com/wenkesj/react-native-voice

[danielsuo]

Example: https://itunes.apple.com/us/app/email-me-notes-in-one-tap/id1090744587?mt=8