NVIDIA / OpenSeq2Seq

Toolkit for efficient experimentation with Speech Recognition, Text2Speech and NLP
https://nvidia.github.io/OpenSeq2Seq
Apache License 2.0
1.54k stars 369 forks source link

[WIP] BlockOut for Jasper #373

Closed AlexGrinch closed 5 years ago

AlexGrinch commented 5 years ago

BlockOut is a regularization technique which drops whole blocks from the graph utilizing the residual connections between them. Has 2 parameters: -- drop_block_prob: float, probability of dropping blocks during training -- drop_block_index: int, index of block to drop on inference