Upload audio file to the cloud + download captions JSON

dylman123 / final-captions-pro

A MacOS app which automatically generates customisable open captions in Final Cut Pro X

1 stars 0 forks source link

Closed dylman123 closed 4 years ago

dylman123 commented 4 years ago

Once an audio track is uploaded to Google Cloud Storage via Firebase, the next step will be to process that audio file "serverlessly" in GCP.
We will use Cloud Functions to do this: https://cloud.google.com/functions
In other words, the plan is to set up an events-based rule that will run code to transcribe audio to text (and possibly even generate captions too) all in the cloud.
Finally the text (or captions) will be sent back to the client with some sort of asynchronous GET request to a "transcribed" bucket via Firebase - need to look into this.

dylman123 commented 4 years ago

dylman123 commented 4 years ago

Need to save JSON data to DB rather than to Storage

dylman123 commented 4 years ago

deleteAudio() is being called too quickly. Need to learn how to synchronise asynchronous functions: https://medium.com/swift2go/synchronysing-the-asynchronous-in-swift-3f91a32bfb1b

dylman123 commented 4 years ago

dylman123 commented 4 years ago

Need to write to Firestore:

https://www.youtube.com/watch?v=v_hR4K4auoQ (Firestore tutorials)
https://www.youtube.com/watch?v=rERRuBjxJ80 (Updating Firestore with Firebase Cloud Functions)
https://www.youtube.com/watch?v=DglTSNEdl0U (write to DB & listen to DB changes - onCreate trigger)

Need to set up Firebase Cloud Messaging for iOS:

dylman123 commented 4 years ago

dylman123 commented 4 years ago

Registered for Apple Developer program $149USD per year. This will allow me to import an Apple certificate into Firebase so that I can configure FCM

dylman123 commented 4 years ago

Had some trouble getting FCM to work. Will stick to short polling for now. And can come back and enable FCM at some later stage.