Open AShoydokova opened 2 years ago
What is the "G identity mapping loss" step? I guess one of the tensors needs to be transposed because dim and length mean different things.
Thank you so much for a quick response! Let me play around with it. The training part is working, but evaluation part is failing.
The G identity mapping loss step is this part code that does something with the train data in Solver.train method:
# G identity mapping loss
x_f0 = torch.cat((x_real_org, f0_org), dim=-1)
x_f0_intrp = self.Interp(x_f0, len_org)
f0_org_intrp = quantize_f0_torch(x_f0_intrp[:,:,-1])[0]
x_f0_intrp_org = torch.cat((x_f0_intrp[:,:,:-1], f0_org_intrp), dim=-1)
I've fixed my issue. The thing was I was creating the speaker embeddings as a 1 dimensional array, while the model expected 2 dimensional. So I have 1085 speakers and for each speaker I created one-hot encoding vector of the size [1085]. While the model expected a vector of the size [1, 1085].
Thank you again for your help!
I have trained the network with extremely poor results. I would like to ask how your validation set is set up? I used directly the demo.pkl file used in the code and found that the loss goes up. Also the hyperparameters given in the source code don't seem to be the same as yours, for example: dim_spk_emb = 82
Hello,
thank you so much for the code and paper! I'm trying to train the model on speech command data. I've made the train and validation data sets through 2 scripts:
make_spect_f0.py
andmake_metadat.py
, but the model fails on the validation step, on this line :x_identic_val = self.G(x_f0, x_real_pad, emb_org_val)
The error is:
RuntimeError: The expanded size of the tensor (192) must match the existing size (1085) at non-singleton dimension 1. Target sizes: [-1, 192, -1]. Tensor sizes: [1085, 1]
.I'm not sure why there is a mismatch as
self.G
worked. Although there is the "G identity mapping loss" step which preprocess the input before feeding toself.G
. Do I need to do the same with the validation data? Also 192 is themax_len_pad = 192
, while 1085 is the number of the speakers (dim_spk_emb = 1085
). Do I need to change the max_len_pad?I'll appreciate for any help or direction!
My hparams.py is below