ilyhalight / voice-over-translation

Небольшое расширение, которое добавляет закадровый перевод видео из YaBrowser в другие браузеры
MIT License
3.6k stars 238 forks source link

Add subtiles from famous site opensubtitles.com and add french tts reader speaker please to dubbung voiceover vostfr streaming with french language useful to learn languages ​​easily and comfortably and also useful for visually impaired viewers please when we have voice overs from subtitles audio track with dubbed voice convert video into translated audio based on open source extension easysubs and plussub ! #863

Open trimechee opened 1 month ago

trimechee commented 1 month ago

Describe your feature / Опишите ваше предложение

Hello, thank you very much for the great awesome amazing Voice-over-translation! 💯 🥇

I have suggestion please : the dream please is add tts reader for french language because recently, my main laptop broke down and I went back to my old little eee pc which has a small screen and I watch vostfr anime and it's hard to read them subtitle and unfortunately I don't understand spoken English very well and the dream is to have dubbing video voiceover tts reader speaker that use french language please, and also we hope feature to add professional subtitles from the famous website opensubtitles.com so we can add verified subtitles with our preferred language (french) to anime video streaming and maybe in future versions, the extension will be able to dubbing voiceover in french the french susbtitles from opensubtitles.com (not .org) which contains french susbtitles , thank you so much :)

Also i find secret rare anime websites that have media player that has rare feature to add with one click native integrated files substitles in almost all languages!!

il will awesome please if the extension can detect this integrated substiles files of the media player of streaming websites and voiceover dubbing read these substitles in french language, thank you!

https://aniwave.se/ https://9animetv.to/ https://movies2watch.tv/

https://hianime.to/home https://hianime.tv/

https://theindex.moe/

https://kuroiru.co/app https://kuroiru.co/

https://everythingmoe.com/#section-streaming https://everythingmoe.com/

https://gogoanimes.mobi/

https://kissanime.com.ru/ https://kissanime.help/ https://kissasian.si/

https://allmanga.to/

https://animefox.sbs/home

https://tv.zoro.se/home https://zoroxtv.info/


UPDATE GREAT NEWS !

UPDATE : great news !!!

Hi again , I was going to the chrome store to install and test the Plussub extension which allows you to add subtitles to a video because I told you that months ago, this extension did not work anymore and I installed it again and now subplus works perfectly......

but by installing the subplus extension, chrome store offered me this extension which has a high rating and I click and I discover that it is an open source extension with the incredible option: "Instant word pronunciation improves your listening and speaking skills with correct pronunciations" !!

I have not yet tried this open source extension if it has a tts for french and if it can read the subtitles in french because I am still in shock and we hope please maybe to be inspired by this open source extension to add the ultimate dream: a tts for french please, thank you very much !!!

https://github.com/Nitrino/easysubs

https://easysubs.cc/en/

https://chromewebstore.google.com/detail/easysubs-%E2%80%93-learn-language/ocelmccppkcibiflhhepafdjjomimddf?utm_source=easysubsco&utm_medium=social&utm_campaign=easysubs_co&hl=en

UPDATE :

I found other tools , may be it can help :

I suggest this featur to mpv based player developer, here his response :

"Please use the mpv script to implement the function you need, or download the script that has already implemented this function from the Internet. These scripts can usually also be used directly in mpv based player."

and here the result of my research about voice synthesizer , maybe it can help :

https://github.com/vincemann/Subtitle-Buddy

https://github.com/carsonip/Penguin-Subtitle-Player

: and https://sourceforge.net/projects/subsplayer/

here the best synthesizer :

https://www.cross-plus-a.com/balabolka.htm

This application that seems can read subtitles in the background while we watch a movie, so users can focus on the action, not on the subtitles:

https://www.softpedia.com/get/Multimedia/Audio/Other-AUDIO-Tools/Titlespeak.shtml

and : https://alternativeto.net/software/subtospeech/about/

Also i discover accessibility tools that improve the tts readers, voice over, synthesizer.....

for example the great NVDA-IBMTTS-Driver :

https://github.com/davidacm/NVDA-IBMTTS-Driver

and also :

This repo contains the pico-tts for NVDA and TTS binaries, This add-on implements NVDA compatibility with the svox-pico synthesizer

https://github.com/davidacm/PicoTTS-NVDA

Also if the extension plan to keep or enhance the great feature : search and add subtitle to streaming video from opensubtitle website, the problem is opensubtilte . org site imposes a limit of 5 subtile per day , maybe the recommendations and advices of Mr Bizilizi can help to fix this limit problem, thank you very much !

Missing Authorization header

https://github.com/plussub/plussub/issues/78

update :

and i find :

rare new era of high-quality, neural text-to-speech voices :

https://github.com/blindpandas/crystal-tts

high-quality attention-free TTS

https://github.com/shivammehta25/Neural-HMM

https://github.com/shivammehta25/Matcha-TTS

https://github.com/blindpandas/Audio-Themes-NVDA-Add-on

https://github.com/blindpandas/command_palette

update :

i made revolutionary discovers about API for Microsoft speech synthesis from Microsoft Edge web browser read aloud and other tools :

https://github.com/alekssamos/msspeech https://pypi.org/project/msspeech/

and

acapela voices online API https://github.com/alekssamos/acapela_box

Yandex Translate NVDA addon https://github.com/alekssamos/YandexTranslate

https://www.nvda.fr/a50

and :

https://github.com/maudoin/ollama-voice https://github.com/willwade/mms-tts-multilingual-models-onnx https://pypi.org/project/pyttsx3/ https://github.com/thevickypedia/py3-tts https://github.com/wannaphong/ttsmms https://pyttsx3.readthedocs.io/en/latest/# https://github.com/nateshmbhat/pyttsx3 https://github.com/mediatechlab/tts-wrapper https://github.com/AceCentre/SpeechBubble

update :

and this natural intonation tts AI :

https://github.com/metavoiceio

https://themetavoice.xyz/

https://github.com/CorentinJ/

https://twitter.com/CorentinJemine

ilyhalight commented 1 month ago

For which sites would it be possible to use subtitles with "opensubtitles"?

Unfortunately, I will not be able to add TTS for French yet because Yandex has disabled it in the api

https://9animetv.to/

Previously, this website was supported, but apparently they changed something in the logic of work

trimechee commented 1 month ago

Thank you very much for reviewing my request Mr @ilyhalight ! 💯 🥇

I may have an answer why this site has changed something in the logic of work:

so es url address of these anime streaming sites, I kept them in a text file, but before posting them in the issue, I wanted to check if these links are valid and I was horrified by the number of obsolete links or sites deleted or which have changed address surely to escape the merciless censorship!

regarding the famous 9anime site, it doesn't work anymore but I have a tip, so I went to check its new address on the sites:

https://www.similarweb.com/fr/

and

https://www.similarsites.com/

these 2 famous sites do not give the official site but give the address of the most popular site on the web which bears the name 9anime so I discovered this new address:

https://9animetv.to/

but I remember the official streaming sites often say that there are several fake sites that copy them .....

so I went to check on the official 9anime reddit page to find the authentic address:

the official 9anime reddit page says that the 9anime reddit is migrating: "we decided with the rebranding of the site....we announced plans to migrate to and we will move to r/aniwave!......"

i go to the new reddit of 9anime which took the name of aniwave:

https://www.reddit.com/r/aniwave/

and I discover that the moderator says the site is permanently closed and dead and the sites with the name 9anime or aniwave are fakes that can scam us or propagate malware according to him.....

be careful, I am not accusing the site:

https://9animetv.to/

and the site

https://aniwave.se/

of being scam sites, perhaps a rebellious member of the 9anime or aniwave team wanted to take over the project by recovering the database, but what is certain is that the sites:

https://aniwave.se/ https://9animetv.to/

are not the original sites which would perhaps explain your comments on this famous 9anime site:

"Previously, this website was supported, but apparently they changed something in the logic of work"


Ohh it's a sad that Yandex browser has disabled it in the api TTS for French :(

it would have made Yandex an even more popular browser especially since chrome which displeases developers with its unilateral decision to migrate to manfest v3......

i installed yandex browser several times in the hope of finding TTS for French but apparently, yandex wants to reserve dubbing video feature for Russian and Kazakh and English languages ​​only, at least for the moment......

in short the Japanese dubbing when watching vostfr videos is not bad but reading subtitles sometimes gives me migraines plus I can't enjoy all the details of the action in the video, the vf dubbing comes several weeks or months after the official release of the anime and I don't like waiting for the vf dubbing haha.....

i ended up finding 2 solutions, the incredible potplayer allows us to add subtitles to the video and has a tts feature to read the subtitles!!!!

same for allplayer, I realized my dream of watching a Japanese anime with a French dubbing tts french made by potplayer or allplayer, but the voices are robotic and in addition I have to download the video first, then look for the subtitles and it's tiring.....

that's why I prefer to use the magnificent our beloved Voice-over translation extension easier and comfortable and faster with natural voices, hoping to improve my level in English, I found an open-source extension months ago that can add subtitles from the opensubtitle site to the streaming video but it didn't work with my favorite streaming site,

https://github.com/plussub/plussub

I hoped to find a tts reader in this extension but it's not the case, so months ago I even asked the developer of Plussub to add a voice synthesizer, and there is 3 days ago, when I discovered the sublime Voice-over-translation, I told him about it so that he could take inspiration and show him it is technically possible.....

but I think it will be very complicated technically for the plussub extension that's why I made the request to the magnificent Voice-over-translation team :)

I know it depends on the Yandex APIs, but can our beloved Voice-over-translation use alternative APIs from Google Translator, Papago Naver Translator from the famous Korean company Naver or Bing Translator because these famous translators have TTS for French?

https://papago.naver.com/


i searched on the chrome store and found this extension which is not open source: Subtitle Reader for Netflix

https://chromewebstore.google.com/detail/subtitle-reader-for-netfl/mefblbojlnanpbommjbkmpfmplmpfaim

but this extension only dubs for netflix and its tts is english and not french, other extensions only dub for youtube.....

i found also this extension that grab subtitles to streaming videos :

https://substital.com/

but sadly, it hasn't also tts reader subtitle for french......

i read news months ago that edge browser will apparently add translation and dubbing of videos using AI but i am currently using my old eee pc windows 7 OS and i can't check if edge browser has added this dubbing feature....

anyway sorry for my very long message and thanks again for this wonderful extension!

and if the magnificent team of Voice-over-translation will have the technical possibility to add a tts for french and we thank you for your generosity and all your efforts to make this exceptional life saver extension which makes our life more comfortable, we hope please my 3 favorite anime streaming sites will be supported please, they are the most famous in france, thank you very much :) :

https://v5.voiranime.com/

https://vostfree.ws/

https://french-anime.com/ https://wiflix.name/ (sans pub) https://wiflix.charity/ https://wiflix.news/

trimechee commented 1 month ago

Mr @ilyhalight, sorry I misunderstood your question, so here for example a site that offers a lot of anime episodes with media player that has integrated embedded subtitles in several languages: we should choose the media player with the acronym notice: S-Dub to test the feature, and we can even change the size and background color of the subtitles:

https://aniwave.se/anime-watch/boruto-naruto-next-generations/ep-1

and apparently the same thing on this site: I can't test because there is a captcha that is looping:

https://kissanime.com.ru/

ilyhalight commented 1 month ago

i read news months ago that edge browser will apparently add translation and dubbing of videos using AI but i am currently using my old eee pc windows 7 OS and i can't check if edge browser has added this dubbing feature....

Translation has already been added to Edge, but there is also a limited list of languages (From: EN, ES, KO | To: RU, ES, HI). And there is a translation made on the user's side, which requires significant PC resources. It looks like they don't have everything ready yet and the translation model just doesn't want to load.

I know it depends on the Yandex APIs, but can our beloved Voice-over-translation use alternative APIs from Google Translator, Papago Naver Translator from the famous Korean company Naver or Bing Translator because these famous translators have TTS for French?

To do this, you need to develop your own translation logic that will convert video into translated audio. I've tried to do something similar, but so far it's not working out very well.

trimechee commented 1 month ago

Ohh very interesting infformations ! Thank you for these clarifications explanations Mr Ilyhalight :)

really it's very disappointing that google chrome and edge can't dubbing translated videos with different languages, chrome can do it with some youtube videos but why not generalize this revolutionary concept to other sites so that people around the world can understand each other?

openai said she did a rigorous casting of actors actresses to add natural realistic voices for her AI which now has the tone of a human, it is too disapointing it is not implemented in edge browser without requiring significant PC resources. especially since microsoft sits on the board of directors of openai.....

i said that after reading the reddit post of 9anime, the 9anime and aniwave sites have definitely disappeared but i just tested the new aniwave.se site and really it is identical to the official site, i do not think that a fake copy can do such sophistication with different servers and subtitles for each episode....

i think the administrator of 9anime who became aniwave probably gave in to pressure and threats and the project was given to someone else who took over....

Mr Ilyhalight , you said this website was supported about 9anime site;;;;

maybe the new aniwave site works like the old 9anime site and maybe it would be good idea to contact the responsible in charge of this important site who can perhaps make technical modifications to facilitate the integration of Voice-over-translation with this site....

the reddit group of aniwave is private and we have to make a request to join them so it is not easy to subscribe to their reddit group....surely to protect themselves from censorship.....

https://www.reddit.com/r/Aniwave_se/

trimechee commented 1 month ago

UPDATE : great news !!!

Hi again Mr @ilyhalight , I was going to the chrome store to install and test the Plussub extension which allows you to add subtitles to a video because I told you that months ago, this extension did not work anymore and I installed it again and now subplus works perfectly......

but by installing the subplus extension, chrome store offered me this extension which has a high rating and I click and I discover that it is an open source extension with the incredible option: "Instant word pronunciation improves your listening and speaking skills with correct pronunciations" !!

I have not yet tried this open source extension if it has a tts for french and if it can read the subtitles in french because I am still in shock and we hope please maybe to be inspired by this open source extension to add the ultimate dream: a tts for french please, thank you very much !!!

https://github.com/Nitrino/easysubs

https://easysubs.cc/en/

https://chromewebstore.google.com/detail/easysubs-%E2%80%93-learn-language/ocelmccppkcibiflhhepafdjjomimddf?utm_source=easysubsco&utm_medium=social&utm_campaign=easysubs_co&hl=en

ilyhalight commented 1 month ago

it looks like he's using Google tts for voice acting (I could be wrong, I only took a cursory look at it)

trimechee commented 1 month ago

Ohh that looks promising!

I'm still incredulous when I read the list of features of this extension on its page on the chrome store and I don't dare download a french subtitles to try ..... we hope there will be a tts for french .....

even if apparently tts of google does not have exactly the same natural tone as Yandex or Openai which uses a gigantic cast of actors / actresses to do the voices of its AI, but it's better than nothing and it will be magnificent if tts reader of google manages to read subtitles in french and other languages .....

several anime whose synopsis I liked are only in vostfr unfortunately ...... new season of bleach begins and I am unfortunately forced to watch in vostfr because I am too impatient and I do not want to wait for the dubbing in vf ....

i changed the issue name to include the name of these 2 open source extensions plussub and easysubs which may help to implement new features to our beloved Voice-over-translation !

trimechee commented 1 month ago

Hi Mr @ilyhalight , i think that Mr @davidacm has many interesting projects and amazing softwares concerning accessibility and could bring his expertise to give ideas and more improve the tts readers, voice over, synthesizer.....

for example the great NVDA-IBMTTS-Driver :

https://github.com/davidacm/NVDA-IBMTTS-Driver

trimechee commented 1 month ago

and also :

This repo contains the pico-tts for NVDA and TTS binaries, This add-on implements NVDA compatibility with the svox-pico synthesizer

https://github.com/davidacm/PicoTTS-NVDA

trimechee commented 1 month ago

Hi Mr @ilyhalight , if our beloved Voice-over-translation plan to add the suggested feature "search and add pro sustitle to video" in order to dubbing voiceover subtitles, the problem is opensubtilte . org site imposes a limit of 5 subtile per day , maybe the recommendations and advices of Mr @Bizilizi can help to fix this limit problem, thank you very much :)

Missing Authorization header

https://github.com/plussub/plussub/issues/78

trimechee commented 1 month ago

and i find :

rare new era of high-quality, neural text-to-speech voices :

https://github.com/blindpandas/crystal-tts

high-quality attention-free TTS

https://github.com/shivammehta25/Neural-HMM

https://github.com/shivammehta25/Matcha-TTS

https://github.com/blindpandas/Audio-Themes-NVDA-Add-on

https://github.com/blindpandas/command_palette

trimechee commented 4 weeks ago

Hi Mr @ilyhalight , i made revolutionary discovers about API for Microsoft speech synthesis from Microsoft Edge web browser read aloud and other tools :

https://github.com/alekssamos/msspeech https://pypi.org/project/msspeech/

and

acapela voices online API https://github.com/alekssamos/acapela_box

Yandex Translate NVDA addon https://github.com/alekssamos/YandexTranslate

https://www.nvda.fr/a50

trimechee commented 4 weeks ago

and :

https://github.com/maudoin/ollama-voice https://github.com/willwade/mms-tts-multilingual-models-onnx https://pypi.org/project/pyttsx3/ https://github.com/thevickypedia/py3-tts https://github.com/wannaphong/ttsmms https://pyttsx3.readthedocs.io/en/latest/# https://github.com/nateshmbhat/pyttsx3 https://github.com/mediatechlab/tts-wrapper https://github.com/AceCentre/SpeechBubble

trimechee commented 2 weeks ago

update :

and this natural intonation tts AI :

https://github.com/metavoiceio

https://themetavoice.xyz/

https://github.com/CorentinJ/

https://twitter.com/CorentinJemine