Closed joecummings closed 1 year ago
Expect batched input to match single input e.g.
Before this would not create the same output1. The issue was that the src_key_padding_mask was not being propagated forward.
Create padding mask and add it to model_kwargs and pass it to the forward function.
model_kwargs
Bug
Expect batched input to match single input e.g.
Before this would not create the same output1. The issue was that the src_key_padding_mask was not being propagated forward.
Fix
Create padding mask and add it to
model_kwargs
and pass it to the forward function.