tobna / TaylorShift

This repository contains the code for the paper "TaylorShift: Shifting the Complexity of Self-Attention from Squared to Linear (and Back) using Taylor-Softmax"
https://tobias.nauen-it.de/publication/taylor-shift/
MIT License
6 stars 0 forks source link