sooftware / conformer

[Unofficial] PyTorch implementation of "Conformer: Convolution-augmented Transformer for Speech Recognition" (INTERSPEECH 2020)
Apache License 2.0
945 stars 174 forks source link

no mask ? #50

Open aijianiula0601 opened 2 years ago

aijianiula0601 commented 2 years ago

For mutihead-attention, I confused that no mask is passed in. Will it work ?

pfeatherstone commented 2 years ago

Yeah I don't think the input lengths are used as masks