search

OpenNLPLab / cosFormer

[ICLR 2022] Official implementation of cosformer-attention in cosFormer: Rethinking Softmax in Attention
Apache License 2.0
176 stars 25 forks source link

Hello, when will the full code be published? #3

Closed zmxsss closed 2 years ago

zmxsss commented 2 years ago

diff += torch.norm(left_res - right_res) What does diff stand for

Doraemonzzz commented 2 years ago
  1. Diff is just to verify the correctness of the implementation.
  2. Full code is in progress.