search

hpcaitech / ColossalAI-Examples

Examples of training models with hybrid parallelism using ColossalAI
Apache License 2.0
334 stars 102 forks source link

Update gpt example with new API #49

Closed ver217 closed 2 years ago

ver217 commented 2 years ago
  1. Update GPT ZeRO example with new ZeRO API.
  2. Update checkpoint with new API.
  3. Update README.