Ultimate dream : bookmarklet to add tts reader for french to dubbing voiceover subtitles in french / Subtitle Reader Speaker with natural voices of the famous yandex company (this feature is also useful for visually impaired viewers !) by taking inspiration from open source extensions Voice-over-translation and EasySubs useful to learn languages easily and comfortably and also useful for visually impaired viewers please when we have voice overs from subtitles audio track with dubbed voice convert video into translated audio !

trimechee commented 1 month ago

Feature description

Hello, my request is a bit weird and wacky, but I'm trying my luck haha,

so I've been watching  anime in french-language  since 3 years because I have difficulty understanding spoken English lol, but the problem is that many good anime are not dubbed in French, streaming sites like voir anime, franch-anime.....offer vostfr but I don't like vostfr which tires my eyes in addition after my laptop broke down, I went back to using my old eee pc from 2012 which has a small screen.....

the solution I found is to download the video, then play it with potplayer or allplayer by adding a subtle file in French and potplayer has a native tts reader voice synthesizer with several times and potplayer can read the subtitles in French so no need to read subtitles, I listen to potlayer pronounce the subtitles with tts reader ....

but it's tiring to have to look for subtitles, download the video.....

i prefer to watch the video directly with the web browser that uses tts reader to read the subtitles of the streaming video, there is the famous Russian browser yandex that uses a neural network to give subtitles to the video and to dubbing substitles voiceover  / Subtitle Reader Speaker with natural voices of the famous yandex company : 

""Video translation and dubbing
The browser can translate video:

into russian - from english, french, german, spanish, italian, chinese, japanese and korean;

into kazakh - from russian and english.

Men speak in a male voice and women in a female voice.

To watch the video in russian or kazakh:

Hover your mouse over the video.

Click on Translate and Voice or . The video will continue to be narrated in your language. " developers have developed extension tools to allow the use of Yandex Browser features even if you do not use Yandex Browsers!! ME-EN.md the problem yandex browser and the voice-over-translation extension do not support dubbing in french :( 

I read a news edge browser will perhaps support dubbing substitles feature using AI but I am using windows 7 os and I cannot currently use edge browser :( I tried with the Subtitles extension Reader

https://chromewebstore.google.com/detail/subtitle-reader-for-netfl/mefblbojlnanpbommjbkmpfmplmpfaim

but this extension does not support my favorite streaming sites....

i tried the specialized extension to add subtitles to streaming videos:

https://github.com/plussub/plussub

but this extension does not support dubbing subtitles....

so the ultimate   dream please  is a bookmarklet=  i playback a vostfr video and i download the subtitles and the bookmarklet uses a tts reader voice synthesizer (maybe using an external service) so i watch the vostfr video and the bookmarklet will read the subtitles file with using tts reader or yandex tool to dubbing substitles in french / Subtitle Reader Speaker with natural voices of the famous yandex company and take inspiration from these open source tools that use yandex dubbing substitles service : 

https://github.com/ilyhalight/voice-over-translation/blob/master/README-EN.md

https://github.com/FOSWLY/vot-cli

UPDATE : great news !!

This night I discover open source extension with the incredible option: "Instant word pronunciation improves your listening and speaking skills with correct pronunciations" !!

I have not yet tried this open source extension if it has a tts for french and if it can read the subtitles in french because I am still in shock and we hope please maybe to be inspired by this open source extension to add the ultimate dream: a tts for french please, thank you very much !!!

https://github.com/Nitrino/easysubs

https://easysubs.cc/en/

https://chromewebstore.google.com/detail/easysubs-%E2%80%93-learn-language/ocelmccppkcibiflhhepafdjjomimddf?utm_source=easysubsco&utm_medium=social&utm_campaign=easysubs_co&hl=en

*********************************

i know it's very complicated and i should have yandex browser and the extension voice-over-translation support dubbing in french , or get a new modern laptop to use edge browser which may have added dubbing feature....

but i'll try my luck, are there bookmarlets or is it technically possible for a bookmarlet to dubbing substiles in french while we watch vostfr streaming video please ?

I allow myself to dream lol because the capabilities of web browsers become incredible by reading this announcement: 

https://wasmer.io/posts/clang-in-browser 

about a major revolutionary technological advance:

 "Running C programs in the browser using the WebAssembly runtime "a major step to make any software work with WebAssembly", according to Wasmer" 

"Compiling native Python libraries directly from within WASIX. Imagine able being to have PIP compiling things in Wasm upon install e.g, .: wasmer run py thon --entrypoint pip -- install numpy # This compiles numpy to WASIX, all within Wasmer processes Using py2wasm with a bundled compiler Compiling Static Hermes to WASIX, so we can generate native Wasm files from JS."

Update : even if i didn't test them because I'm in shock and my old eee pc is weak, I found new extensions with realistic voiceover dubbing by using the latest model powered by GPT-4o..... :

https://fluentai.pro/ https://github.com/yazykextension/forum/discussions

https://www.languagereactor.com/

and

https://ai.opensubtitles.com/ https://www.opensubtitles.org/fr

https://app.vivalabs.ai/

and i find also tts api , the unofficial tts api of microsoft edge....i will post all my discovries discoveries and it will be a reference that could help to make a tts bookmarklet :

https://www.opensubtitles.com/fr https://www.opensubtitles.org/fr

https://easysubs.cc/fr/ nitrinodev@gmail.com https://t.me/easysubs_ext https://nitrino.dev/ https://github.com/Nitrino/easysubs

https://github.com/ilyhalight/voice-over-translation https://github.com/sodapng/voice-over-translation https://github.com/FOSWLY/vot-cli https://toil.cc/

FluentAI : Sous-titres doubles pour Netflix et plu https://fluentai.pro/ Yazyk Language Learning with Netflix https://github.com/yazykextension/forum/discussions https://chromewebstore.google.com/detail/fluentai-sous-titres-doub/hbghjfaenddmdpbkobgdcgkmcdcdjjko https://discord.gg/zAmzU4wmQN https://t.me/+QmmVGxbf-Po0NGI0

https://github.com/plussub/plussub https://github.com/ste-xx http://stefan.breitenstein.dev/ https://twitter.com/_____ste_____

https://substital.com/ support@substital.com Substital extension Chat https://t.me/+H2hYjbBEKnszZWIy https://www.youtube.com/channel/UCedSumIkKa5tpBg6BmRT2Ig https://twitter.com/substital

Language Reactor https://www.languagereactor.com/ languagelearningextension@gmail.com

Subtitle Reader for Netflix https://chromewebstore.google.com/detail/subtitle-reader-for-netfl/mefblbojlnanpbommjbkmpfmplmpfaim Browser Extensions contact@vodextended.com

https://ai.opensubtitles.com/ https://www.opensubtitles.org/fr

https://app.vivalabs.ai/

microsoft edge browser voiceover https://www.microsoft.com/fr-fr/edge/?form=MA13FJ&ch=1

yandex browser feature translation and video dubbing voiceover https://browser.yandex.com/help/ru/search-and-browse/translators-settings#videos https://browser.yandex.com/

sous-titre substitles media streaming player https://github.com/vincemann/subtitle-buddy https://sourceforge.net/projects/subsplayer/

https://www.cross-plus-a.com/balabolka.htm

https://pot-app.com/en/ https://github.com/pot-app/pot-desktop support@pot-app.com

https://github.com/carsonip/Penguin-Subtitle-Player https://sourceforge.net/projects/subsplayer/

https://www.softpedia.com/get/Multimedia/Audio/Other-AUDIO-Tools/Titlespeak.shtml https://alternativeto.net/software/subtospeech/about/

https://github.com/alekssamos/YandexTranslate aleks-samos@yandex.ru https://alekssamos.github.io/ https://t.me/alekssamos https://vk.com/alekssamos

https://www.nvda.fr/a50

Anything else?

No response

trimechee commented 1 month ago

More informations about this unique yandex feature

translation and video dubbing :

https://browser.yandex.com/help/ru/search-and-browse/translators-settings#videos

trimechee commented 1 month ago

Mr @thomasleplus, sorry for long message, just to be clearer please, what I hope to say, for example I playback a vostfr streaming video in the web browser, and I go to the famous opensubstitle site to look for the subtitle corresponding to the episode of the anime that I am watching, and I click on the boobkmarklet which will detect the online subtitle on the opensubstiles page or why not the bookmarklet activates the subtitle downloaded locally and while I watch the streaming video, the bookmarklet reads speak the subtitle using an external service or the tts voices of windows os or the natural voices of yandex:

Worker proxy-server for voice-over-translation : https://github.com/FOSWLY/vot-worker

https://github.com/FOSWLY/vot-backend

https://github.com/FOSWLY/media-converter-backend

https://github.com/FOSWLY/translate-backend https://github.com/FOSWLY/vot.js

trimechee commented 1 month ago

and :

https://github.com/ilyhalight/voice-over-translation

https://github.com/FOSWLY/vot-cli

trimechee commented 1 month ago

Hi, also i find secret rare anime websites that have media player that has rare feature to add with one click native integrated files substitles in almost all languages!!

il will awesome please if the eventual bookmarket can detect this integrated substiles files of the media player of streaming websites and voiceover dubbing read these substitles in french language, thank you!

https://aniwave.se/ https://9animetv.to/ https://movies2watch.tv/

https://hianime.to/home https://hianime.tv/

https://theindex.moe/

https://kuroiru.co/app https://kuroiru.co/

https://everythingmoe.com/#section-streaming https://everythingmoe.com/

https://gogoanimes.mobi/

https://kissanime.com.ru/ https://kissanime.help/ https://kissasian.si/

https://allmanga.to/

https://animefox.sbs/home

https://tv.zoro.se/home https://zoroxtv.info/

trimechee commented 1 month ago

Hi, I talk with the developer of Voice-over-translation extension to ask him to support a tts for french in streaming websites with has emedded subtitles comme dans ce site streaming that offers a lot of anime episodes with media player that has integrated embedded subtitles in several languages: we should choose the media player with the acronym notice: S-Dub to test the feature, and we can even change the size and background color of the subtitles:

https://aniwave.se/anime-watch/boruto-naruto -next-generations/ep-1

https://github.com/ilyhalight/voice-over-translation

he replied “Unfortunately, I will not be able to add TTS for French yet because Yandex has disabled it in the api "

so I asked him if Voice-over-translation can use alternative APIs from Google Translator, Papago Naver Translator from the famous Korean company Naver or Bing Translator because these famous translators have TTS for French?

and he replied:

"To do this, you need to develop your own translation logic that will convert video into translated audio. I've tried to do something similar, but so far it's not working out very well. "

so while waiting for Yandex to hopefully add tts for french API, since, if I'm not mistaken, chrome apparently doesn't offer a tts reader, it would be great to have a tts reader bookmarklet to read the news article for example, maybe by sending the article to an external service, or using a windows os tts....

trimechee commented 1 month ago

UPDATE : great news !!

Hi again Mr @thomasleplus ,this night I discover open source extension with the incredible option: "Instant word pronunciation improves your listening and speaking skills with correct pronunciations" !!

I have not yet tried this open source extension if it has a tts for french and if it can read the subtitles in french because I am still in shock and we hope please maybe to be inspired by this open source extension to add the ultimate dream: a tts for french please, thank you very much !!!

https://github.com/Nitrino/easysubs

https://easysubs.cc/en/

https://chromewebstore.google.com/detail/easysubs-%E2%80%93-learn-language/ocelmccppkcibiflhhepafdjjomimddf?utm_source=easysubsco&utm_medium=social&utm_campaign=easysubs_co&hl=en

thomasleplus commented 1 month ago

Hi @trimechee,

I apologize for not responding sooner but I am currently traveling for work. I will review your issues after I come back and got some rest. Also I should confess that I am not a Javascript expert so I will do my best to implement the issues that I can.

Cheers,

Tom

trimechee commented 1 month ago

Great ! Thank you so much Mr Tom @thomasleplus :) and sorry for my too long messages !

i think my ultimate dream has already come true thanks God by finding 2 days ago the rare easysubs open source extension which allows us to read french subtitles, even if I haven't tried this extension yet because I'm still so incredulous and shocked.....

so voilà, my request now is just a french tts reader to read press articles but if it's going to tire you out too much and it's too complex..... there is no need to make this bookmarklet anymore :) or please just keep this suggestion just for the future if javascript technology becomes mature enough and enough handy, integrable, easy..... thank you :)

trimechee commented 2 weeks ago

Update : even if i didn't test them because I'm in shock and my old eee pc is weak, I found new extensions with realistic voiceover dubbing by using the latest model powered by GPT-4o..... :

https://fluentai.pro/ https://github.com/yazykextension/forum/discussions

https://www.languagereactor.com/

and

https://ai.opensubtitles.com/ https://www.opensubtitles.org/fr

https://app.vivalabs.ai/

trimechee commented 2 weeks ago

and i find also tts api , the unofficial tts api of microsoft edge....i will post all my discovries discoveries and it will be a reference that could help to make a tts bookmarklet:, i will ad these discoveries in the first post :

https://www.opensubtitles.com/fr https://www.opensubtitles.org/fr

https://easysubs.cc/fr/ nitrinodev@gmail.com https://t.me/easysubs_ext https://nitrino.dev/ https://github.com/Nitrino/easysubs

https://github.com/ilyhalight/voice-over-translation https://github.com/sodapng/voice-over-translation https://github.com/FOSWLY/vot-cli https://toil.cc/

FluentAI : Sous-titres doubles pour Netflix et plu https://fluentai.pro/ Yazyk Language Learning with Netflix https://github.com/yazykextension/forum/discussions https://chromewebstore.google.com/detail/fluentai-sous-titres-doub/hbghjfaenddmdpbkobgdcgkmcdcdjjko https://discord.gg/zAmzU4wmQN https://t.me/+QmmVGxbf-Po0NGI0

https://github.com/plussub/plussub https://github.com/ste-xx http://stefan.breitenstein.dev/ https://twitter.com/_____ste_____

https://substital.com/ support@substital.com Substital extension Chat https://t.me/+H2hYjbBEKnszZWIy https://www.youtube.com/channel/UCedSumIkKa5tpBg6BmRT2Ig https://twitter.com/substital

Language Reactor https://www.languagereactor.com/ languagelearningextension@gmail.com

Subtitle Reader for Netflix https://chromewebstore.google.com/detail/subtitle-reader-for-netfl/mefblbojlnanpbommjbkmpfmplmpfaim Browser Extensions contact@vodextended.com

https://ai.opensubtitles.com/ https://www.opensubtitles.org/fr

https://app.vivalabs.ai/

microsoft edge browser voiceover https://www.microsoft.com/fr-fr/edge/?form=MA13FJ&ch=1

yandex browser feature translation and video dubbing voiceover https://browser.yandex.com/help/ru/search-and-browse/translators-settings#videos https://browser.yandex.com/