In order to support model partitioning, evaluators need to be able to send node activation values across evaluator boundaries regardless of the epoch period. Although this is possible through REEF's Network (Connection) Service, we'd like to have a well-designed abstraction that handles such communication (possible candidate is Shuffle).
In order to support model partitioning, evaluators need to be able to send node activation values across evaluator boundaries regardless of the epoch period. Although this is possible through REEF's Network (Connection) Service, we'd like to have a well-designed abstraction that handles such communication (possible candidate is Shuffle).