jalammar / ecco

Explain, analyze, and visualize NLP language models. Ecco creates interactive visualizations directly in Jupyter notebooks explaining the behavior of Transformer-based language models (like GPT2, BERT, RoBERTA, T5, and T0).
https://ecco.readthedocs.io
BSD 3-Clause "New" or "Revised" License
1.96k stars 167 forks source link

Problem with saliency() #78

Closed Poul-Andersson closed 2 years ago

Poul-Andersson commented 2 years ago

I'm unable to get the saliency() commands in the notebook "Language_Models_and_Ecco_PyData.ipynb" to function. Given the command "output_3.saliency()", the error message is: "'OutputSeq' object has no attribute 'saliency'". Would greatly appreciate suggestions. Poul

jalammar commented 2 years ago

That's an outdated code block, sorry. See the https://github.com/jalammar/ecco/blob/main/notebooks/Ecco_Primary_Attributions.ipynb notebook for saliency (which is now renamed to primary_attributions)