i-machine-think / diagNNose

diagNNose is a Python library that facilitates a broad set of tools for analysing hidden activations of neural models.
https://diagnnose.readthedocs.io
MIT License
81 stars 8 forks source link

Fix model top_layer in syntax #71

Closed jumelet closed 3 years ago

jumelet commented 3 years ago

https://github.com/i-machine-think/diagNNose/blob/4512fcd0a56369e83b5349c2f8cf034fe860ca33/diagnnose/syntax/task.py#L145

Transformer output should be normalized asap (perhaps return -1 for model.top_layer as a hotfix for now?)