Performance Regression or Improvement: pytorch_image_classification_benchmarks-resnet101-mean_inference_batch_latency_micro_secs:mean_inference_batch_latency_micro_secs

[github-actions[bot]]

Performance change found in the test: pytorch_image_classification_benchmarks-resnet101-mean_inference_batch_latency_micro_secs for the metric: mean_inference_batch_latency_micro_secs.

For more information on how to triage the alerts, please look at Triage performance alert issues section of the README.

Test description: Pytorch image classification on 50k images of size 224 x 224 with resnet 101. Test link - https://github.com/apache/beam/blob/42d0a6e3564d8b9c5d912428a6de18fb22a13ac1/.test-infra/jenkins/job_InferenceBenchmarkTests_Python.groovy#L34 Test dashboard - http://metrics.beam.apache.org/d/ZpS8Uf44z/python-ml-runinference-benchmarks?orgId=1&viewPanel=2

timestamp: Mon Aug 14 18:19:03 2023, metric_value: 4499253.64
timestamp: Sun Aug 13 18:18:21 2023, metric_value: 4579284.80
timestamp: Sat Aug 12 18:18:01 2023, metric_value: 4540231.68
timestamp: Fri Aug 11 18:22:50 2023, metric_value: 4562882.83
timestamp: Thu Aug 10 18:31:22 2023, metric_value: 4706314.64
timestamp: Wed Aug  9 18:20:39 2023, metric_value: 4499391.44
timestamp: Tue Aug  8 19:33:41 2023, metric_value: 4648045.91
timestamp: Mon Aug  7 18:21:00 2023, metric_value: 4527919.92
timestamp: Sun Aug  6 18:18:21 2023, metric_value: 4593467.59 <---- Anomaly
timestamp: Sat Aug  5 18:18:37 2023, metric_value: 4640704.50
timestamp: Fri Aug  4 18:18:47 2023, metric_value: 4701437.57
timestamp: Thu Aug  3 18:30:50 2023, metric_value: 4478775.48
timestamp: Wed Aug  2 18:22:25 2023, metric_value: 4627538.10
timestamp: Wed Aug  2 13:43:54 2023, metric_value: 4730867.34
timestamp: Tue Aug  1 18:37:26 2023, metric_value: 4756923.80
timestamp: Tue Aug  1 18:20:33 2023, metric_value: 4580034.19
timestamp: Mon Jul 31 18:20:31 2023, metric_value: 4585577.94
timestamp: Mon Jul 31 13:34:56 2023, metric_value: 4613043.67
timestamp: Sun Jul 30 18:18:44 2023, metric_value: 4748424.84

[riteshghorse]

Close as not planned

[riteshghorse]

resnet101 latency hasn't changed much