decker-edu / decker

A markdown based tool for slide deck creation.
GNU General Public License v3.0
53 stars 13 forks source link

Transcribe embedded videos with Whisper #106

Open monofon opened 4 months ago

monofon commented 4 months ago

Automatically transcribe embedded videos marked with {.transcribe} using Whisper.

This could either be done

a) during a normal decker run, or b) on the next invocation of decker transcribe.

Option a) will take some time, whenever a new video is added to the decks. Option b) will take more effort to implement.

salbeira commented 4 months ago

Does whisper detect the original language of the medium it is transcribing?

How do users get access to whisper.cpp? For the "normal user" it is just another external dependency, if it is not installed a normal run of "decker" should not try to do anything.

What about videos the user already has subtitle information for? See #29