OpenNLPLab / cosFormer

[ICLR 2022] Official implementation of cosformer-attention in cosFormer: Rethinking Softmax in Attention
Apache License 2.0
176 stars 25 forks source link

When the code will be released? #1

Closed LeeDoYup closed 2 years ago

LeeDoYup commented 2 years ago

Thanks for the awesome project. I wonder when the code will be released. Thank you ;)

Doraemonzzz commented 2 years ago

Thanks for the awesome project. I wonder when the code will be released. Thank you ;)

We will be uploading the code in stages, and have currently uploaded the core cosformer-attention section.