fix rotary bug when q seqlen > cos seqlen

THUDM / SwissArmyTransformer

SwissArmyTransformer is a flexible and powerful library to develop your own Transformer variants.

https://THUDM.github.io/SwissArmyTransformer

Apache License 2.0

951 stars 90 forks source link

Closed leizhao1234 closed 7 months ago