Optim Perf Signal Detected by TorchBench CI on '56af607c0437ed7321da4b96a4dbccdbd8b5a98b'

[github-actions[bot]]

TorchBench CI has detected a performance signal or runtime regression.

Base PyTorch commit: 56af607c0437ed7321da4b96a4dbccdbd8b5a98b

Affected PyTorch commit: 56af607c0437ed7321da4b96a4dbccdbd8b5a98b

Affected Tests:

• DALLE2_pytorch, Adam, cuda, fused, amsgrad, maximize: +45.06670%
• DALLE2_pytorch, Adam, cuda, fused, capturable, amsgrad: +36.11691%
• DALLE2_pytorch, AdamW, cuda, foreach: +49.40952%
• DALLE2_pytorch, AdamW, cuda, fused, amsgrad, maximize: +38.32376%
• timm_vision_transformer_large, RAdam, cuda, no_foreach: -44.00085%
• timm_vision_transformer_large, RAdam, cuda, differentiable: -44.24940%
• hf_T5_large, Rprop, cuda, differentiable: +30.94747%
• Super_SloMo, RMSprop, cuda, differentiable: +52.56252%
• hf_Reformer, Adadelta, cuda, differentiable: +32.41173%
• timm_efficientnet, Adadelta, cuda, no_foreach: +36.42987%
• phlippe_densenet, Adamax, cuda, no_foreach: +37.26340%
• phlippe_densenet, NAdam, cuda, no_foreach: +45.02834%

Tests that were no longer run on affected commit:

Tests that were newly added on affected commit:

Runtime regressions found? An errors log was found. Please investigate runtime errors by looking into the logs of the workflow linked.

GitHub workflow that triggered this issue: https://github.com/pytorch/benchmark/actions/runs/6503858966

cc @janeyx99

[janeyx99]

Noise, conglomerating in https://github.com/pytorch/benchmark/issues/1988