CorentinJ / Real-Time-Voice-Cloning

Clone a voice in 5 seconds to generate arbitrary speech in real-time
Other
52.37k stars 8.76k forks source link

Here is a model in Mandarin/Chinese 中文模型 #811

Closed babysor closed 3 years ago

babysor commented 3 years ago

Finally I got it work and it's really fun that you are listening to your own voice. 终于可以玩耍起来了, Link:https://pan.baidu.com/s/10t3XycWiNIg5dN5E_bMORQ Code:aid4

Codebase: https://github.com/babysor/Realtime-Voice-Clone-Chinese

babysor commented 3 years ago

这个模型只是synthesizer ,encoder和vocoder只需要用作者pretrained的

9527-567 commented 3 years ago

我在尝试以这个框架为基础来实现中国方言的TTS,请问您具体是怎么建立新的synthesizer的? @babysor

babysor commented 3 years ago

我在尝试以这个框架为基础来实现中国方言的TTS,请问您具体是怎么建立新的synthesizer的? @babysor

我主要改写了tacotron部分的代码使其能使用中文的dataset进行train。 我不认为这里voice clone可以做到accent clone,accent跟数据集相关,我试过我自己的clone,效果上只是声音像,但口音更像使用的数据集中的口音。

babysor commented 3 years ago

https://www.bilibili.com/video/BV1sA411P7wM/ demo video

zhuzaileiting commented 3 years ago

大佬

ecnishad commented 3 years ago

Is it support chinese input or do we need to input in English like in your video?

babysor commented 3 years ago

Is it support chinese input or do we need to input in English like in your video?

now you can input in chinese

ghost commented 3 years ago

I can't download the pretrained models, can someone upload to a different file sharing service?

ecnishad commented 3 years ago

I can't download the pretrained models, can someone upload to a different file sharing service?

Use this website with mortix https://baidu.kinh.cc/

codexq123 commented 3 years ago

请问你从头训练中文模型要多少语音量呢?如果训练数据有杂音有影响吗?像你这样只训练synthesizer,我需要很多不同的人的语音数据吗?

babysor commented 3 years ago

请问你从头训练中文模型要多少语音量呢?如果训练数据有杂音有影响吗?像你这样只训练synthesizer,我需要很多不同的人的语音数据吗?

200小时 有杂音效果会差一些。人需要多个

oerooo commented 3 years ago

你好,百度网盘链接失效了,可以麻烦大佬再发一遍么?跪谢

babysor commented 3 years ago

你好,百度网盘链接失效了,可以麻烦大佬再发一遍么?跪谢

链接:https://pan.baidu.com/s/1mBAGFdDFm7gUdazjtCDfXw 提取码:pm92 --来自百度网盘超级会员V3的分享

oerooo commented 3 years ago

你好,百度网盘链接失效了,可以麻烦大佬再发一遍么?跪谢

链接:https://pan.baidu.com/s/1mBAGFdDFm7gUdazjtCDfXw 提取码:pm92 --来自百度网盘超级会员V3的分享

十分感谢!!!!!

ghost commented 3 years ago

Closing this inactive issue. I have added it to a list of models in #30. Thank you for the contribution.

ALIXGUSTAF commented 2 years ago

@babysor please can you guide me how is adding Arabic language to [Real-Time-Voice-Cloning] program step by step

ALIXGUSTAF commented 2 years ago

@ghost please can you guide me how is adding Arabic language to [Real-Time-Voice-Cloning] program step by step

wangsnail1985 commented 2 years ago

希望能一起讨论学习 训练中文accent qq 群 867722852

haiderasad commented 2 years ago

@babysor any chance we can get Chinese model in google drive link? Baidu is not accessible outside china