Migrated GPT-3 examples

hpcaitech / ColossalAI-Examples

Examples of training models with hybrid parallelism using ColossalAI

Apache License 2.0

334 stars 102 forks source link

Closed Gy-Lu closed 2 years ago

Gy-Lu commented 2 years ago

Migrated GPT-3 examples.

FrankLeeeee commented 2 years ago

Hi, please do the same as mentioned in the gpt-2 PR reply.