search

apache / beam

Apache Beam is a unified programming model for Batch and Streaming data processing.
https://beam.apache.org/
Apache License 2.0
7.78k stars 4.21k forks source link

Performance Regression or Improvement: test_cloudml_benchmark_criteo_10GB-runtime_sec:runtime_sec #32076

Closed github-actions[bot] closed 3 weeks ago

github-actions[bot] commented 1 month ago

Performance change found in the test: test_cloudml_benchmark_criteo_10GB-runtime_sec for the metric: runtime_sec.

For more information on how to triage the alerts, please look at Triage performance alert issues section of the README.

Test description: TFT Criteo test on 10 GB data. Test link - https://github.com/apache/beam/blob/42d0a6e3564d8b9c5d912428a6de18fb22a13ac1/sdks/python/apache_beam/testing/benchmarks/cloudml/cloudml_benchmark_test.py#LL104C7-L104C41


timestamp: Sat Aug  3 22:49:16 2024, metric_value: 2593.85
timestamp: Fri Aug  2 23:13:27 2024, metric_value: 2790.80
timestamp: Thu Aug  1 22:53:19 2024, metric_value: 2634.35
timestamp: Wed Jul 31 22:50:56 2024, metric_value: 2589.74
timestamp: Tue Jul 30 22:51:04 2024, metric_value: 2642.89 <---- Anomaly
timestamp: Mon Jul 29 22:43:57 2024, metric_value: 2357.23
timestamp: Sun Jul 28 22:40:05 2024, metric_value: 2333.11
timestamp: Sat Jul 27 22:44:07 2024, metric_value: 2397.39
timestamp: Fri Jul 26 22:44:17 2024, metric_value: 2376.70
timestamp: Thu Jul 25 22:50:11 2024, metric_value: 2733.78
timestamp: Wed Jul 24 22:52:18 2024, metric_value: 2394.04
timestamp: Tue Jul 23 22:43:23 2024, metric_value: 2391.77
timestamp: Mon Jul 22 22:48:21 2024, metric_value: 2456.50
timestamp: Sun Jul 21 22:41:58 2024, metric_value: 2372.70
timestamp: Sat Jul 20 22:58:28 2024, metric_value: 2416.68
github-actions[bot] commented 1 month ago

Performance change found in the test: test_cloudml_benchmark_criteo_10GB-runtime_sec for the metric: runtime_sec.

For more information on how to triage the alerts, please look at Triage performance alert issues section of the README.

Test description: TFT Criteo test on 10 GB data. Test link - https://github.com/apache/beam/blob/42d0a6e3564d8b9c5d912428a6de18fb22a13ac1/sdks/python/apache_beam/testing/benchmarks/cloudml/cloudml_benchmark_test.py#LL104C7-L104C41


timestamp: Sun Aug 11 23:07:42 2024, metric_value: 3151.57
timestamp: Sat Aug 10 23:08:58 2024, metric_value: 3146.44
timestamp: Fri Aug  9 23:12:09 2024, metric_value: 3147.46 <---- Anomaly
timestamp: Thu Aug  8 22:48:24 2024, metric_value: 2595.21
timestamp: Wed Aug  7 22:52:05 2024, metric_value: 2624.92
timestamp: Tue Aug  6 22:50:31 2024, metric_value: 2540.81
timestamp: Mon Aug  5 22:46:13 2024, metric_value: 2524.17
timestamp: Sun Aug  4 22:46:05 2024, metric_value: 2557.27
timestamp: Sat Aug  3 22:49:16 2024, metric_value: 2593.85
timestamp: Fri Aug  2 23:13:27 2024, metric_value: 2790.80
timestamp: Thu Aug  1 22:53:19 2024, metric_value: 2634.35
timestamp: Wed Jul 31 22:50:56 2024, metric_value: 2589.74
timestamp: Tue Jul 30 22:51:04 2024, metric_value: 2642.89