hpcaitech / ColossalAI-Examples

Examples of training models with hybrid parallelism using ColossalAI
Apache License 2.0
334 stars 102 forks source link

Invalid Import in GPT Example #25

Closed FrankLeeeee closed 2 years ago

FrankLeeeee commented 2 years ago

In the __init__.py of the GPT examples, BERT is imported. This will make the code broken. Could you fix this and test the example?