-
This issue is to track the follow-up work to #1137, which introduced `rnnt_loss` and `RNNTLoss` as a [prototype](https://pytorch.org/audio/stable/index.html) in `torchaudio.prototype.transducer` using…
-
Hi @scutcsq , saw your repo and tracking your training, have you able to generate some good quality speech ?
Please share some samples or pretrained model if possible.
Thanks for code.
-
Hi, I'm using rnnt-loss and pytorch-lightning to train my model. But I found the 4D tensor which is used to calculate transducer will be accumulated in GPU, when I check the GPU memory in training ste…
-
Does lingvo include the RNN-Transducer loss computation ?
-
I created a confomer-rnn-trasducer recipe using CSJ and run the training process.
When I evaluated the created model, the CERs for eval1, eval2, and eval3 were higher than the [original paper](https:…
-
I trained two offline reworked conformer models on my own Chinese data using pruned_rnnt_loss and standard rnnt loss (warp-rnnt==0.7.0) respectively following pruned_transducer_stateless5. However, I …
-
I am try to use this implementation with apex half precision training, but it can't.
showing that it need float rather that half:
______________
File "/data/asr_v3/src/model/transformer_transduc…
-
I am getting nan outputs from the encoder of pruned transducer streaming model.
tensor([[[nan, nan, nan, ..., nan, nan, nan],
[nan, nan, nan, ..., nan, nan, nan],
[nan, nan, nan…
-
- [x] Auto mixed precision and loss scaling
- [x] Fix transducer embedding tflite conversion (tflite conversion raises a bug when using `tf.gather` in `tf.while_loop`)
- [x] Fix transducer tflite co…
-
I have trained a Conformer model using my own custom dataset in Thai. However, GPU Utilization seems to be pretty low as the training speed is pretty slow (~2 s/batch). The GPU was utilized by around …