Add support for GAN front-end training and evaluation

mravanelli / pytorch-kaldi

pytorch-kaldi is a project for developing state-of-the-art DNN/RNN hybrid speech recognition systems. The DNN part is managed by pytorch, while feature extraction, label computation, and decoding are performed with the kaldi toolkit.

2.37k stars 446 forks source link

Add support for GAN front-end training and evaluation #258

Closed walterheymans closed 2 years ago

walterheymans commented 2 years ago

Summary

Support is added to train a Guided-GAN front-end and use it to improve the performance of a trained acoustic model. The updates include:

The scripts used to train models are updated to support a GAN front-end.
GAN training script is added.
Data augmentation scripts are added.
Example config files are provided.
Example GAN models have been added.
Weights and Biases are integrated for online experiment tracking.
Documentation is updated.