Closed ppebay closed 11 months ago
Key findings:
As a result, the results of the call to __cluster_objects()
on the destination rank must always be “enriched” with the notional empty cluster, denoted as: None: []
Example of 16 iterations of the too-complex
case, in non-deterministic mode:
N.B.: load imbalance continues to decrease and is not blocked at that level, past iteration 16.
Verifying that has no negative impact on other, previously well resolved, cases:
@nlslatt should I nonetheless merge, while you are further investigating?
@nlslatt should I nonetheless merge, while you are further investigating?
No, see Slack.
Results with new execution logic (now only one target allowed to be picked but with an arbitrary numbers of swaps):
Much better results and with fewer iterations
Further improved strategy, both for execution speed and load imbalance:
Results also improved for the challenging_toy_hundreds_tasks
case (also in non-deterministic mode):
@ppebay This is working better for me as well
Thanks @nlslatt @lifflander , can we merge this PR?
Fixes #428