tlh24 / cortex

Apache License 2.0
7 stars 0 forks source link

Mse attention #14

Closed tlh24 closed 1 year ago

tlh24 commented 1 year ago

Following a bit of experimentation here, MSE / L2 attention morphed to L1 attention, and is now in it's own repo: https://github.com/tlh24/l1-attention

merging the changes on this branch back into main accordingly.