Zennit is a high-level framework in Python using PyTorch for explaining/exploring neural networks using attribution methods like LRP.
183
stars
33
forks
source link
remove nn.MultiheadAttention from Activation types.py #191
Closed
rachtibat closed 1 year ago
Bugfix: Zennit assigns per default the Pass rule to the nn.MultiheadAttention layer. However, the MultiheadAttention module requires another rule.