issues
search
THUDM
/
SwissArmyTransformer
SwissArmyTransformer is a flexible and powerful library to develop your own Transformer variants.
https://THUDM.github.io/SwissArmyTransformer
Apache License 2.0
951
stars
90
forks
source link
mqa cross & stream chat
#147
Closed
1049451037
closed
9 months ago
1049451037
commented
9 months ago
Add multi-query attention for cross attention.
Add stream chat.