search

horovod / horovod

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
http://horovod.ai
Other
14.06k stars 2.22k forks source link

When to fit PaddlePaddle? #2807

Open gongel opened 3 years ago

gongel commented 3 years ago

Hi all, When to fit PaddlePaddle ? Here is its repo: https://github.com/PaddlePaddle/Paddle

Thanks

tgaddair commented 3 years ago

Hey @gongel, thanks for reaching out. It would be great to integrate PaddlePaddle with Horovod. Is there anyone from the PaddlePaddle team that would interested in taking this on? If so, I'd be happy to meet to discuss what would need to be done from the Horovod side.

HydrogenSulfate commented 1 year ago

In fact, there is already a distributed framework in paddle, called paddle.distributed. You can use API in paddle.distributed for DistributedDataParallel training or other case