baseline for sentence classification task using IG/Deeplift?

jalammar / ecco

Explain, analyze, and visualize NLP language models. Ecco creates interactive visualizations directly in Jupyter notebooks explaining the behavior of Transformer-based language models (like GPT2, BERT, RoBERTA, T5, and T0).

https://ecco.readthedocs.io

BSD 3-Clause "New" or "Revised" License

1.96k stars 167 forks source link

baseline for sentence classification task using IG/Deeplift? #114

Open lkqnaruto opened 5 months ago

lkqnaruto commented 5 months ago

For sentence classification task for BERT using IG/Deeplift, what is the underlying baseline? PAD token? Unknown Token? or customized? Thank you.