search

rhasspy / piper

A fast, local neural text to speech system
https://rhasspy.github.io/piper-samples/
MIT License
5.77k stars 416 forks source link

get error for add new speaker to a multi-speaker checkpoint #568

Closed mniiinm closed 1 month ago

mniiinm commented 1 month ago

If the checkpoint is multi-speaker, For example, Checkpoint has 2 speakers and I want to finetune it and add a new speaker to it, so that it becomes 3. It's impossible? i get this error: size mismatch for model_g.emb_g.weight: copying a param with shape torch.Size([2, 512]) from checkpoint, the shape in current model is torch.Size([3, 512]).

synesthesiam commented 1 month ago

That is correct. A new speaker can't be added by extending the number of speakers since that changes the size of the network.

You can fine tune to replace an existing speaker, or have some speaker ids left unused for the future.