A prototype repo for hybrid training of pipeline parallel and distributed data parallel with comments on core code snippets. Feel free to copy code and launch discussions about the problems you have encoured.
45
stars
2
forks
source link
hey bro! your project help me a lot! You are my hero!!! #2
Kindly give a star to us! Thanks!