This is a repository with the code for the ACL 2019 paper "Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned" and the ACL 2021 paper "Analyzing Source and Target Contributions to NMT Predictions".
298
stars
46
forks
source link
Revert "Update for the "source and target contributions" paper" #4
Reverts lena-voita/the-story-of-heads#3