Symmetrical argument for self_weight, src_weights, dst_weights - Githubissues

Bluefog-Lib / bluefog

Distributed and decentralized training framework for PyTorch over graph

https://bluefog-lib.github.io/bluefog/

Apache License 2.0

291 stars 71 forks source link

Symmetrical argument for self_weight, src_weights, dst_weights #82

Open hanbinhu opened 3 years ago

hanbinhu commented 3 years ago

The pattern for neighbor_allreduce arguments may be

self_weight, src_weights, dst_weights are all none (Disable dynamic)
self_weight + src_weights (Enable dynamic, infer dst_weights using Python API)
self_weight + dst_weights (Enable dynamic, infer src_weights using Python API)
self_weight + src_weights + dst_weights (Enable dynamic)