[feature] polish code and doc in gradient accumulation feature - Githubissues

hpcaitech / ColossalAI-Examples

Examples of training models with hybrid parallelism using ColossalAI

Apache License 2.0

334 stars 102 forks source link

[feature] polish code and doc in gradient accumulation feature #102

Closed FrankLeeeee closed 2 years ago

FrankLeeeee commented 2 years ago

removed unnecessary code
merged the train_with_engine and train_with_trainer scripts
updated readme