search

hpcaitech / ColossalAI

Making large AI models cheaper, faster and more accessible
https://www.colossalai.org
Apache License 2.0
38.69k stars 4.34k forks source link

[shardformer] support tp/pp for RoBERTa #4419

Open Fridge003 opened 1 year ago

BlacPharaoh commented 1 year ago

please describe the issue