koaning / tokenwiser

Bag of, not words, but tricks!
https://koaning.github.io/tokenwiser/
Apache License 2.0
68 stars 7 forks source link

Self Attention Methods #15

Closed koaning closed 3 years ago

koaning commented 3 years ago

We can add post processors that apply a reweighting of the vectors. Ideas that pop up;