search

myshell-ai / DreamVoice

83 stars 10 forks source link

Plugin mode for other VC model? #9

Open ShawnPi233 opened 1 month ago

ShawnPi233 commented 1 month ago

Thanks for your great work! But I just don't understand how can I use the DreamVG model in other zero-shot VC models, since the speaker embedding predicted from the text prompt can't share the same embedding space with other VC models. Should we finetune the VC model with the speaker embedding from DreamVG?

haidog-yaqub commented 1 month ago

hi there, actually you can train a dreamvc plugin on the speaker embedding space used in the pretrained vc model by keep vc model frozen. As the dreamvc plugin is super light, it can be trained in just few hours on the dreamvc db.