[feature] update zero exmaple

hpcaitech / ColossalAI-Examples

Examples of training models with hybrid parallelism using ColossalAI

Apache License 2.0

334 stars 102 forks source link

Closed ver217 closed 2 years ago

ver217 commented 2 years ago

Update ZeRO exmaple with the latest ShardedModelV2.

FrankLeeeee commented 2 years ago

LGTM.