Open HanielF opened 2 years ago
When use forward() function, there is no direct way to use attention mask since we haven't compute attention matrix. If you need use attention mask, we suggest you use left_product, however, this will get loss in efficiency.
Compared with
left_product
function, attention mask is not used inforward()
function. How to use the attention mask in the forward method?