Dynamic neighbor allgather

Bluefog-Lib / bluefog

Distributed and decentralized training framework for PyTorch over graph

https://bluefog-lib.github.io/bluefog/

Apache License 2.0

291 stars 71 forks source link

Closed BichengYing closed 3 years ago

BichengYing commented 3 years ago

Add src_rank and dst_ranks arguments in neighbor_allgather, which allows the dynamic topology usage