Closed tlh24 closed 1 year ago
Following a bit of experimentation here, MSE / L2 attention morphed to L1 attention, and is now in it's own repo: https://github.com/tlh24/l1-attention
merging the changes on this branch back into main accordingly.
Following a bit of experimentation here, MSE / L2 attention morphed to L1 attention, and is now in it's own repo: https://github.com/tlh24/l1-attention
merging the changes on this branch back into main accordingly.