search

mpv-player / mpv

🎥 Command line video player
https://mpv.io
Other
26.77k stars 2.84k forks source link

Is it possible to OCR playing video using OCR backend like Tesseract #13864

Open gunir opened 2 months ago

gunir commented 2 months ago

I'm trying to make mpv OCR a video to detect subtitles and translate to another window, mostly for watching movies that I don't understand and language learning, but the issue is I can't find API to capture screen to memory, or even more important, capture region to memory (to make OCR more accurate and cost less resource, because smaller = faster ? Is there APIs like that ?

fideliochan commented 2 months ago

There are already projects that allow you to do this.

cold-nagai commented 2 months ago

It'd be better to translate subtitles beforehand via whisper. https://github.com/abb128/LiveCaptions Also exists.