apache / beam

Apache Beam is a unified programming model for Batch and Streaming data processing.
https://beam.apache.org/
Apache License 2.0
7.84k stars 4.24k forks source link

Performance Regression or Improvement: test_cloudml_benchmark_criteo_10GB-runtime_sec:runtime_sec #30338

Closed github-actions[bot] closed 8 months ago

github-actions[bot] commented 8 months ago

Performance change found in the test: test_cloudml_benchmark_criteo_10GB-runtime_sec for the metric: runtime_sec.

For more information on how to triage the alerts, please look at Triage performance alert issues section of the README.

Test description: TFT Criteo test on 10 GB data. Test link - https://github.com/apache/beam/blob/42d0a6e3564d8b9c5d912428a6de18fb22a13ac1/sdks/python/apache_beam/testing/benchmarks/cloudml/cloudml_benchmark_test.py#LL104C7-L104C41


timestamp: Fri Feb 16 22:44:37 2024, metric_value: 2659.48
timestamp: Thu Feb 15 22:52:34 2024, metric_value: 3031.95
timestamp: Thu Feb 15 20:59:34 2024, metric_value: 2205.56
timestamp: Wed Feb 14 23:07:56 2024, metric_value: 3973.62
timestamp: Tue Feb 13 22:40:28 2024, metric_value: 2292.96
timestamp: Mon Feb 12 22:41:28 2024, metric_value: 2691.95
timestamp: Sun Feb 11 22:42:05 2024, metric_value: 2861.31 <---- Anomaly
timestamp: Sat Feb 10 22:35:53 2024, metric_value: 2131.16
timestamp: Fri Feb  9 22:34:48 2024, metric_value: 2359.42
timestamp: Thu Feb  8 22:53:14 2024, metric_value: 2168.82
timestamp: Wed Feb  7 22:36:09 2024, metric_value: 2286.79
timestamp: Wed Feb  7 19:58:49 2024, metric_value: 2097.99
timestamp: Wed Feb  7 18:02:28 2024, metric_value: 2335.75
timestamp: Wed Feb  7 17:34:53 2024, metric_value: 2194.32
timestamp: Tue Feb  6 22:36:33 2024, metric_value: 2104.21
timestamp: Tue Feb  6 22:23:51 2024, metric_value: 2219.09
timestamp: Mon Feb  5 22:37:06 2024, metric_value: 2236.03
tvalentyn commented 8 months ago

looks like noise