search

JRMeyer / multi-task-kaldi

An example directory for running Multi-Task Learning training on Kaldi neural networks. In Kaldi-speak, this is an egs dir for nnet3 training.
Apache License 2.0
54 stars 16 forks source link

Domain label classification task #6

Open brijmohan opened 3 years ago

brijmohan commented 3 years ago

Dear @JRMeyer ,

Thanks for creating a repo for multitask learning in Kaldi. It is much needed. I have two questions regarding MTL in Kaldi.

  1. I have speech datasets from two different domains and I want to add another branch in this TDNN architecture which would classify prefinal-l into those domains. I think I will have to modify the egs to contain the domain labels, but how will this label be provided to this branch during training?
  2. I want to combine ASR training with speaker classification (x-vector) architecture. I think the above egs modification will suffice here too.

Could you please provide me some guidelines how to go about these?

Thanks! Brij

Helaly96 commented 2 years ago

Did you reach anything?