search

Bluefog-Lib / bluefog

Distributed and decentralized training framework for PyTorch over graph
https://bluefog-lib.github.io/bluefog/
Apache License 2.0
291 stars 71 forks source link

win_sync interface change #13

Closed hanbinhu closed 4 years ago

hanbinhu commented 4 years ago
  1. Split original weights into self_weight (float) and neighbor_weights (dict[int, float]), so that the definition of neighbor inside the topology is consistent to the one of neighbor weights here.
  2. Remove update_weights, and replace it with reset. The neighbor tensor to be reset is specified through neighbor_weights.
  3. Ignore self_neighbor and reset value when neighbor_weights is not provided.

TODO: weight definition in the topology might require change as well.

hanbinhu commented 4 years ago

@ybc1991 I think that's the current behavior. What is the confusion?