hpcaitech / ColossalAI-Examples

Examples of training models with hybrid parallelism using ColossalAI
Apache License 2.0
333 stars 102 forks source link

Cannot find the gradient handler example #171

Open DarrenYing opened 1 year ago

DarrenYing commented 1 year ago

📚 The doc issue

We provide a runnable example to demonstrate the use of gradient handler. In this example, we used DataParallelGradientHandler instead of PyTorch DistributedDataParallel for data parallel training.

The example of using customized gradient handler is not found and the url in the doc is 404

binmakeswell commented 1 year ago

Hi @DarrenYing Thank you for your feedback. We will fix it soon. By the way, we are restructuring the documents and examples, and the new version examples will be provided at the following link https://github.com/hpcaitech/ColossalAI/tree/main/examples