[shardformer]swintransformer support tp

hpcaitech / ColossalAI

Making large AI models cheaper, faster and more accessible

https://www.colossalai.org

Apache License 2.0

38.72k stars 4.34k forks source link

[shardformer]swintransformer support tp #4562

Open flybird11111 opened 1 year ago

Issues-translate-bot commented 1 year ago

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

Title: [shardformer]swin transformer support tp