Aleksoid1978 / MPC-BE

MPC-BE – универсальный проигрыватель аудио и видеофайлов для операционной системы Windows.
GNU General Public License v3.0
1.88k stars 83 forks source link

Add speech synthesizer to subtitles for visually impaired viewers #424

Closed trimechee closed 3 months ago

trimechee commented 3 months ago

Hello, thank you so much for this awesome fantastic wonderful media player ! 💯 🥇

Please i have request : we can download anime in Japanese from streaming sites which have 700 episodes which can be tiring to read the subtitles and we can find the subtitles easily so we hope for the addition of a speech synthesizer to "experience video in a whole new way with "Speech Synthesizer" feature into streaming videos subtitles, reading them aloud through a sophisticated speech synthesizer that closely mimics the human voice. Choose from acclaimed voices like Ivona or the built-in Windows narrator voices such as Microsoft Paulina, Julie, Zira, or Adam (standard in Windows 11).

This feature is perfect for those who prefer listen audio of pdf books and prefer listening over reading, or for visually impaired viewers, adding an extra dimension to your video-watching experience to enjoy videos in a way that suits us best, only with MPC-BE :) "

and also please if possible add "Revolutionary AI-Powered Voice-Over Feature" :

Add an innovative AI-powered voice-over feature, changing the way viewers experience videos. Utilizing advanced artificial intelligence technology for voice generation, the AI Voice-over provides a unique experience comparable to a real human narrator to enjoy videos without the need to read subtitles while still listening to the authentic voices of actors.

AI Voice-over is for those who dislike movie dubbing that destroys the true voice and authenticity of actors. For visually impaired individuals who have difficulty reading subtitles. For those who like to play movies in the background while doing other tasks and don't want to focus on reading subtitles. Perfect for lovers of original soundtracks who also seek support in understanding dialogues. This function, developed by ElevenLabs.io - a world leader in this field, we hope it will be available to all MPC-BE users to offer the innovative AI Voice-over technology enriches the film experience, combining the comfort of listening with the authenticity of the original performance."

Thank you so much !

v0lt commented 3 months ago

I can’t imagine how this can be added to MPC-BE. Therefore it is not planned.

But if you show us a working patch, we will consider your proposal.

trimechee commented 3 months ago

Sorry, I'm not a developer but I tested speech synthesizer with the subtitles in Potplayer and Allplayer and it works!

I didn't quite understand, it seems some of the code for Allplayer is open-source, for Potlayer I don't think it's open-source.....

https://allplayer.org/ https://github.com/SaraEye https://potplayer.daum.net/ https://tv.kakao.com/guide/potplayer

v0lt commented 3 months ago

I did not find any patches related to this topic from your links.

trimechee commented 3 months ago

@v0lt I suggest this featur to mpv based player, here his response :

"Please use the mpv script to implement the function you need, or download the script that has already implemented this function from the Internet. These scripts can usually also be used directly in mpv-easy player."

and Mr @v0lt , may be it can help, I would like to point out that I am not an expert but just an average user:

https://github.com/vincemann/Subtitle-Buddy

https://github.com/carsonip/Penguin-Subtitle-Player

This application that seems developed by your Russian compatriot can read subtitles in the background while we watch a movie, so you can focus on the action, not on the subtitles:

https://www.softpedia.com/get/Multimedia/Audio/Other-AUDIO-Tools/Titlespeak.shtml

and : https://alternativeto.net/software/subtospeech/about/

Aleksoid1978 commented 3 months ago

Not planned.

trimechee commented 3 months ago

Yes, i think tts voices need to be more natural to be more attrictive, may be with AI, any way thank you for having considered ma request and we hope Mpc-be will fix the problem playback with mail.ru, i talked to the developer of QmPlay2 and he fixes this issue with mail.ru....and we hope Mpc-be will do the same specially Mpc-be and QmPlay2 use the same yt-dlp engine....

trimechee commented 2 months ago

here the best synthesizer https://www.cross-plus-a.com/balabolka.htm