search

hpcaitech / ColossalAI-Examples

Examples of training models with hybrid parallelism using ColossalAI
Apache License 2.0
334 stars 102 forks source link

[zero] add gpt zero-pipeline-1d tensor parallel config #51

Closed ver217 closed 2 years ago