search

THUDM / SwissArmyTransformer

SwissArmyTransformer is a flexible and powerful library to develop your own Transformer variants.
https://THUDM.github.io/SwissArmyTransformer
Apache License 2.0
951 stars 90 forks source link

mqa cross & stream chat #147

Closed 1049451037 closed 9 months ago

1049451037 commented 9 months ago
  1. Add multi-query attention for cross attention.
  2. Add stream chat.