YoMio-Tech-Inc / GPT-SoVITS2

GPT-SoVITS2
MIT License
54 stars 3 forks source link

Release Date for GPT-SoVITS Modifications #1

Open Bubarinokk opened 1 week ago

Bubarinokk commented 1 week ago

Hello, I would like to know when these modifications in GPT-SoVITS will be released (I don't know if they have been released yet).

JunityZhan commented 1 week ago

Hi, This is a repo for GPT-SoVITS2. If you are asking about when does GPT-SoVITS2 release, then I would say probably before mid July, and the pretrained model would be before August. Best

Bubarinokk commented 1 week ago

Hi, This is a repo for GPT-SoVITS2. If you are asking about when does GPT-SoVITS2 release, then I would say probably before mid July, and the pretrained model would be before August. Best

Ahh ok! Another question: Will the multilingual model be included in the fine-tuning as well?

JunityZhan commented 1 week ago

GPT-SoVITS2 is multilingual TTS System, which means you can input any language into it. However, the performance may vary based on training dataset.

Bubarinokk commented 1 week ago

GPT-SoVITS2 is multilingual TTS System, which means you can input any language into it. However, the performance may vary based on training dataset.

I was referring to whether the changes in GPT-SoVITS2 (including the addition of new languages) will be included in the training/fine-tuning.

JunityZhan commented 1 week ago

There is a concept should be noted. While GPT-SoVITS do need manually add a new language, GPT-SoVITS2 does not explicitly "add" new language. It works like a LLM like ChatGPT, you can input any language into it. In this case, if you are refereing if there is other language training dataset, I would say I will add them if I see there is good open-source multi-lingual TTS dataset, then it will be added to the training. Specifically we can expect GPT-SoVITS2 works best on English, Chinese, Japanese, Korean, but other language like Spanish... would also be added if the multi-lingual TTS training dataset is including them.

abf524 commented 3 days ago

Hi, i want to ask something about gpt sovits2, is this gpt sovits2 will also fork in google colab? and can gpt sovits support Indonesian language?

JunityZhan commented 2 days ago

If you have a lot of Indonesian dataset, you could send them here: zlk1715069210@gmail.com. If they are trained in the pretrained model, you can easily use GPT SOVITS2 in Indonesian language without further finetuning

AngryBearr commented 2 days ago

There is a trained model for russian language, will you add that as well? It's specifically trained so that it would have the knowledge of the emphasis when it encounters the + sign it knows that it has to put the emphasis on a voul. Here is the link to the model on the HF and a repo link with the inference code to run the model.