lowerquality / gentle

gentle forced aligner
https://lowerquality.com/gentle/
MIT License
1.44k stars 296 forks source link

other language support #144

Open lsq357 opened 6 years ago

lsq357 commented 6 years ago

Thank you for excellent work! Any other language support other than english?

strob commented 6 years ago

There was some effort (#140) on custom models, and I am very interested in supporting non-English languages, but unfortunately no others are currently implemented.

On Sun, Oct 29, 2017 at 6:55 PM, 493238731 notifications@github.com wrote:

Thank you for excellent work! Any other language support other than english?

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/lowerquality/gentle/issues/144, or mute the thread https://github.com/notifications/unsubscribe-auth/AAMupx8MubdNDk7oRgX9IIrB6OwArjLwks5sxSyqgaJpZM4QKlJk .

Kyubyong commented 6 years ago

What exactly do we have do for supporting non-English languages?

saurabhvyas commented 6 years ago

if implemented this would be a killer feature.

wkranti commented 6 years ago

The support for languages other than English is presently maintained on RED HEN LABS website. Current Idea is to extend support to Spanish after that for Chinese,Russian,German.It would take few months to complete.Detailed tutorial would be available on how to align using gentle for Non-English languages.

agangzz commented 6 years ago

If I want to extend gentle to other language, such as Chinese, how should I do? what about the details training processing?Thanks

wkranti commented 6 years ago

Hello agangzz, Presently, Shuwie Xu , Zhaoqing Xu are working on Chinese part . Here are their Github handler CynthiaSuwi , xuzhaoqing . You can see their progress on their Github pages.Although it would require some time to complete it . If you can wait, otherwise if you want to make it yourself follow this steps,I pre-assume you are familiar with kaldi,
1)Fork Gentle. 2) Use it with English , Check alignment output format.(It may help you in step 3 ) 3) Check scripts in gentle folder ,Information is given inside every python script. 4)Rest you can figure out yourself regarding how scripts needs to be changed in order to do alignment in Chinese. Above mentioned steps are tedious,take some time to understand. Regarding training process you can follow tutorials on Kaldi official website they also have google group for help , they would obviously provided more information than I did. I can't tell every aspect of it ,but this is good head start to achieve alignment in Non-English languages.

arogozhnikov commented 6 years ago

Would be great to be able to use this tool with pre-trained models from montreal-forced-aligner (those are also kaldi models,AFAIK). Is it possible?

errolyan commented 6 years ago

I want to know Chinese support now?If there is no support, have a good way to solve the problem of alignment in Chinese

ybNo1 commented 5 years ago

I want to know Chinese support now?If there is no support, have a good way to solve the problem of alignment in Chinese

hi, could you share your ideas about how to align in Chinese? or the main steps I should do pls?

wclr commented 5 years ago

@wkranti

The support for languages other than English is presently maintained on RED HEN LABS website. Current Idea is to extend support to Spanish after that for Chinese,Russian,German.It would take few months to complete.Detailed tutorial would be available on how to align using gentle for Non-English languages.

Is there some available progress on this matter?

sailordiary commented 5 years ago

I want to know Chinese support now?If there is no support, have a good way to solve the problem of alignment in Chinese

hi, could you share your ideas about how to align in Chinese? or the main steps I should do pls?

I've managed to integrate my own TDNN model trained using the official AISHELL-2 recipe -- I'll write a short post about how this can be done soon. Meanwhile you can take a look at https://github.com/lowerquality/gentle/issues/113#issuecomment-303932840 .

Jackiexiao commented 5 years ago

@sailordiary Great work, could you share the post? thx!

mueller91 commented 3 years ago

any update on this? anybody tackling german?

SaadBazaz commented 2 years ago

Been waiting for German and Chinese for months! Any update?

gnmarten commented 2 years ago

+1

Nichalas commented 2 years ago

+1

Kthulu120 commented 1 year ago

Looks like there are existing models out there for this. Just a matter of hooking these up and extending the code base to support model as an input option.