petuum / autodist

Simple Distributed Deep Learning on TensorFlow
https://petuum.github.io/autodist
Apache License 2.0
134 stars 26 forks source link

Add Pipeline parallelism strategy to AutoDist #44

Open zhisbug opened 4 years ago

zhisbug commented 4 years ago

System information

Describe the new feature and the current behavior/state Pipeline parallelism explained: https://arxiv.org/abs/1811.06965

Will this change the current API? How?

Describe alternatives you've considered

Additional context