-
Hi,
I wonder if we can manually verify attention mask patterns during testing. While I can visualize masks by printing them as strings, I'm looking to add proper test assertions.
- How to assert…
-
Hi, thanks for an wonderful work!
I have an question about the optimization object. It is seems that the optimized additional residual information can make the network pay more attention on the spe…
-
so nice job, but when I visual the attention map follow the #3 , however, I get the bellow result, someone can help me? Thanks
attn = self.softmax(attn_logits)
attn…
-
Dear authors,
I wanted to express my gratitude to you again! Your work immensely inspired me.
I was wondering if you could kindly explain the relationship between the variables `offset`, `batch…