search

THUDM / SwissArmyTransformer

SwissArmyTransformer is a flexible and powerful library to develop your own Transformer variants.
https://THUDM.github.io/SwissArmyTransformer
Apache License 2.0
937 stars 88 forks source link

OPT, BLOOM? #73

Open xloem opened 1 year ago

xloem commented 1 year ago

It's quite inspiring you've made a library that works to unify the shared components of mainstream model architectures.

I was a little surprised to see that it didn't have support for OPT and BLOOM.

Any plans for these?

Sleepychord commented 1 year ago

Hi, good suggestion. We will find some members to integrate them.

iMountTai commented 1 year ago

如果能支持OPT，那真的是非常期待了。