search

jalammar / ecco

Explain, analyze, and visualize NLP language models. Ecco creates interactive visualizations directly in Jupyter notebooks explaining the behavior of Transformer-based language models (like GPT2, BERT, RoBERTA, T5, and T0).
https://ecco.readthedocs.io
BSD 3-Clause "New" or "Revised" License
1.98k stars 169 forks source link

How to use ECCO to explain FineTuned T5 for Conditional Generation ? #74

Closed tejas20 closed 2 years ago

tejas20 commented 2 years ago

I am trying to use ECCO to explain the output of FinedTuned T5 for Conditional Generation model which is fine tuned on table-to-text dataset. I am not able to load my model with the conditional generation. Can you give me an example code of how to load local transformer models?

tejas20 commented 2 years ago

Also example input from table is - List of Governors of South Carolina Governors under the Constitution of 1868

76 # 74 75 Daniel Henry Chamberlain Governor 76 December 1, 1874 Took Office 76
And Example output is - Daniel Henry Chamberlain was the 76th Governor of South Carolina from 1874. Can ecco explain the input to output considering the in input text.

jalammar commented 2 years ago

You can load the local model as long as you provide its config info. See this notebook for config info. You can probably use the same configurations of the original T5 (find these in the model-config file).

tejas20 commented 2 years ago

Thank you, Jay.