search

Makememo / MemoAI

MemoAI Video to translated text, subtitles and notes made easy.
https://memo.ac
471 stars 5 forks source link

Auto-sync: Turn transcript text into captions like YouTube Studio and Descript #14

Open candideu opened 1 year ago

candideu commented 1 year ago

Describe the solution you'd like YouTube allows people to paste or upload a plain text transcript for a video, and it will automatically assign timings for the text to generate timed captions, which can then be exported as .srt, .vtt, etc. This feature is called Auto-Sync. Descript offers a similar syncing feature.

Would Whisper allow to create a similar feature in Memo?

Makememo commented 1 year ago

I understand that the procedure is to convert a video to text and then paste the text in Memo. Does Memo match the text with the subtitles?

Am I getting this right? If so, we will support later versions.

candideu commented 1 year ago

Not quite. The procedure would be that user has a video or audio with text transcript of the media. The text has no timing information, and the user would like to generate captions/subtitles from that text. So the user provider the media and the text, and the platform automatically adds timing and syncs up the text to the media.

This tutorial provides a good demo of the feature on Descript: https://www.youtube.com/watch?v=dzAexFlyNNI

Makememo commented 1 year ago

Got It. Thank you!