apache / beam

Apache Beam is a unified programming model for Batch and Streaming data processing.
https://beam.apache.org/
Apache License 2.0
7.84k stars 4.24k forks source link

Performance Regression or Improvement: test_cloudml_benchmark_cirteo_no_shuffle_10GB-runtime_sec:runtime_sec #30136

Closed github-actions[bot] closed 8 months ago

github-actions[bot] commented 8 months ago

Performance change found in the test: test_cloudml_benchmark_cirteo_no_shuffle_10GB-runtime_sec for the metric: runtime_sec.

For more information on how to triage the alerts, please look at Triage performance alert issues section of the README.

Test description: TFT Criteo test on 10 GB data with no Reshuffle. Test link - Test link


timestamp: Fri Jan 26 21:58:24 2024, metric_value: 2270.22
timestamp: Thu Jan 25 21:55:31 2024, metric_value: 2108.64
timestamp: Wed Jan 24 21:55:26 2024, metric_value: 2052.88
timestamp: Tue Jan 23 22:22:03 2024, metric_value: 3575.69
timestamp: Mon Jan 22 22:13:44 2024, metric_value: 3104.94
timestamp: Sun Jan 21 21:55:36 2024, metric_value: 2019.71
timestamp: Sat Jan 20 22:26:24 2024, metric_value: 3877.70 <---- Anomaly
timestamp: Fri Jan 19 21:57:06 2024, metric_value: 2109.51
timestamp: Thu Jan 18 21:56:17 2024, metric_value: 2119.32
timestamp: Wed Jan 17 22:01:27 2024, metric_value: 2220.79
timestamp: Tue Jan 16 22:05:04 2024, metric_value: 2364.28
timestamp: Mon Jan 15 21:55:11 2024, metric_value: 2033.75
timestamp: Sun Jan 14 21:55:33 2024, metric_value: 2090.18
timestamp: Sat Jan 13 21:55:12 2024, metric_value: 2076.07
timestamp: Fri Jan 12 22:03:26 2024, metric_value: 2483.83
timestamp: Thu Jan 11 21:56:47 2024, metric_value: 2182.49
timestamp: Wed Jan 10 21:55:30 2024, metric_value: 2097.24
tvalentyn commented 8 months ago

looks like a temporary anomaly