Optim Perf Signal Detected by TorchBench CI on '8c684663042a61de20f163ab6a292cd43c67e294'

[github-actions[bot]]

TorchBench CI has detected a performance signal or runtime regression.

Base PyTorch commit: 2c3aa09cde00fe4b45307770ebc86178d61773e7

Affected PyTorch commit: 8c684663042a61de20f163ab6a292cd43c67e294

Affected Tests:

• mobilenet_v3_large, Adadelta, cuda, differentiable: +43.35396%
• mobilenet_v3_large, AdamW, cuda, no_foreach: +47.85973%
• mobilenet_v3_large, AdamW, cuda, differentiable: +35.74592%
• mobilenet_v3_large, SGD, cuda, no_foreach: +41.62527%
• mobilenet_v3_large, RMSprop, cuda, no_foreach: +52.92799%
• opacus_cifar10, Adam, cuda, no_foreach: +44.78348%
• opacus_cifar10, RMSprop, cuda, differentiable: +48.32945%
• phlippe_densenet, Adamax, cuda, maximize: +35.26371%
• phlippe_densenet, RMSprop, cuda, differentiable: +52.33228%
• doctr_reco_predictor, Adagrad, cuda, differentiable: +31.70632%
• mobilenet_v2, Adam, cuda, differentiable: +35.75587%
• moco, RMSprop, cuda, differentiable: +49.00914%
• DALLE2_pytorch, Adam, cuda, amsgrad, maximize: +31.66236%
• DALLE2_pytorch, AdamW, cuda, amsgrad, maximize: +32.70095%
• DALLE2_pytorch, RAdam, cuda, default: +33.38843%
• hf_Whisper, ASGD, cuda, foreach: +53.27004%
• hf_Whisper, RMSprop, cuda, differentiable: +35.19851%
• mnasnet1_0, AdamW, cuda, no_foreach: +36.39512%
• hf_Reformer, AdamW, cuda, no_foreach: +47.05424%
• hf_T5_base, Adadelta, cuda, no_foreach: +40.63222%
• hf_T5_base, AdamW, cuda, no_foreach: +42.40198%
• hf_T5_base, ASGD, cuda, foreach: +34.62303%
• hf_T5_large, Rprop, cuda, no_foreach: +44.36867%

Tests that were no longer run on affected commit:

Tests that were newly added on affected commit:

Runtime regressions found? An errors log was found. Please investigate runtime errors by looking into the logs of the workflow linked.

GitHub workflow that triggered this issue: https://github.com/pytorch/benchmark/actions/runs/6020392233

cc @janeyx99

[janeyx99]

Seems related to https://github.com/pytorch/benchmark/issues/1839