This task is a precursor to https://github.com/dask/distributed/issues/8673. Before developing the heuristic, we should track if (and by how much) clusters grew during P2P operations and expose this information for successful and failed P2P operations via an event. This will allow us to understand the impact of such a heuristic and what good thresholds might look like.
This task is a precursor to https://github.com/dask/distributed/issues/8673. Before developing the heuristic, we should track if (and by how much) clusters grew during P2P operations and expose this information for successful and failed P2P operations via an event. This will allow us to understand the impact of such a heuristic and what good thresholds might look like.