Finding attention scores for self-attention visualisation

ardigen / MAT

The official implementation of the Molecule Attention Transformer.

MIT License

239 stars 57 forks source link

Finding attention scores for self-attention visualisation #17

Open nigelnnk opened 2 years ago

nigelnnk commented 2 years ago

Hi there! In the MAT paper, there were visualisations of the self-attention weights that were produced for one molecule. I am a bit unsure of where these self-attention weights can be located in the transformers.py file. Do you have any advice? Thanks!