Update for the "source and target contributions" paper

lena-voita / the-story-of-heads

This is a repository with the code for the ACL 2019 paper "Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned" and the ACL 2021 paper "Analyzing Source and Target Contributions to NMT Predictions".

296 stars 46 forks source link

Update for the "source and target contributions" paper #5

Closed lena-voita closed 3 years ago

lena-voita commented 3 years ago

Layerwise Relevance Propagation (LRP)
Minimum Risk Training (MRT)
some other stuff
notebooks with LRP and graphs