search

hpcaitech / ColossalAI-Examples

Examples of training models with hybrid parallelism using ColossalAI
Apache License 2.0
334 stars 102 forks source link

Add ZeRO example #20

Closed jiezhuzzz closed 2 years ago

jiezhuzzz commented 2 years ago

Add zero example and fix some grammar errors