issues
search
OpenNLPLab
/
cosFormer
[ICLR 2022] Official implementation of cosformer-attention in cosFormer: Rethinking Softmax in Attention
Apache License 2.0
176
stars
25
forks
source link
Hello, when will the full code be published?
#3
Closed
zmxsss
closed
2 years ago
zmxsss
commented
2 years ago
diff += torch.norm(left_res - right_res) What does diff stand for
Doraemonzzz
commented
2 years ago
Diff is just to verify the correctness of the implementation.
Full code is in progress.
diff += torch.norm(left_res - right_res) What does diff stand for