dask / distributed

A distributed task scheduler for Dask
https://distributed.dask.org
BSD 3-Clause "New" or "Revised" License
1.57k stars 718 forks source link

Eagerly update aggregate statistics for `TaskPrefix` instead of calculating them on-demand #8681

Closed hendrikmakait closed 3 months ago

hendrikmakait commented 3 months ago

Closes #8680

github-actions[bot] commented 3 months ago

Unit Test Results

_See test report for an extended history of previous test failures. This is useful for diagnosing flaky tests._

    29 files  ±    0      29 suites  ±0   11h 3m 47s :stopwatch: + 1h 19m 38s  4 057 tests  -     5   3 953 :white_check_mark: +    5     97 :zzz:  -   9  7 :x: +3  55 883 runs  +7 589  53 712 :white_check_mark: +7 354  2 163 :zzz: +249  8 :x: +3 

For more details on these failures, see this check.

Results for commit c84d42d0. ± Comparison against base commit 5708bdf3.

This pull request removes 14 and adds 9 tests. Note that renamed tests count towards both. ``` distributed.protocol.tests.test_arrow distributed.protocol.tests.test_collection distributed.protocol.tests.test_highlevelgraph distributed.protocol.tests.test_numpy distributed.protocol.tests.test_pandas distributed.shuffle.tests.test_graph distributed.shuffle.tests.test_merge distributed.shuffle.tests.test_merge_column_and_index distributed.shuffle.tests.test_metrics distributed.shuffle.tests.test_rechunk … ``` ``` distributed.diagnostics.tests.test_memray ‑ test_basic_integration_scheduler distributed.diagnostics.tests.test_memray ‑ test_basic_integration_scheduler_report_args[False] distributed.diagnostics.tests.test_memray ‑ test_basic_integration_scheduler_report_args[report_args0] distributed.diagnostics.tests.test_memray ‑ test_basic_integration_workers[1] distributed.diagnostics.tests.test_memray ‑ test_basic_integration_workers[False] distributed.diagnostics.tests.test_memray ‑ test_basic_integration_workers[True] distributed.diagnostics.tests.test_memray ‑ test_basic_integration_workers_report_args[False] distributed.diagnostics.tests.test_memray ‑ test_basic_integration_workers_report_args[report_args0] distributed.tests.test_scheduler ‑ test_task_group_and_prefix_statistics ```

:recycle: This comment has been updated with latest results.