V2 Performance Signal Detected by TorchBench CI on '2.3.0.dev20240130+cu121'

[xuzhao9]

TorchBench CI has detected a performance signal.

Base PyTorch version: 2.3.0.dev20240127+cu118

Base PyTorch commit: fe10b1800f5df432532fc91e0d553a521ec53479

Affected PyTorch version: 2.3.0.dev20240130+cu121

Affected PyTorch commit: dcc077eea2f95a9d5caa65eeca4d8c73e207f61d

Affected Tests:

• test_train[Super_SloMo-cuda-eager]: -7.47195%
• test_eval[Super_SloMo-cuda-eager]: +10.42605%
• test_train[Super_SloMo-cuda-jit]: -7.53183%
• test_eval[Super_SloMo-cuda-jit]: +10.53007%
• test_train[dcgan-cuda-eager]: -9.97524%
• test_eval[dcgan-cuda-eager]: -7.26311%
• test_train[dcgan-cuda-jit]: -10.01823%
• test_eval[hf_T5-cpu-eager]: +20.98431%
• test_eval[mnasnet1_0-cuda-jit]: -9.02097%
• test_eval[pyhpc_equation_of_state-cpu-jit]: +7.70336%
• test_train[timm_regnet-cuda-eager]: +13.83100%
• test_eval[timm_regnet-cuda-eager]: -63.66011%
• test_train[timm_regnet-cuda-jit]: +14.27366%
• test_eval[timm_regnet-cuda-jit]: -78.27843%
• test_train[yolov3-cuda-eager]: +12.31370%

cc @xuzhao9

Result json:

{
  "start": "fe10b1800f5df432532fc91e0d553a521ec53479",
  "end": "dcc077eea2f95a9d5caa65eeca4d8c73e207f61d",
  "threshold": 7,
  "timeout": 120,
  "torchbench_branch": "v2.0",
  "result": [
    {
      "commit1": "0ed24cb1afb",
      "commit1_time": "2024-01-30 02:07:34 +0000",
      "commit1_digest": {
        "test_eval[pyhpc_equation_of_state-cpu-jit]": 0.07681977916508913
      },
      "commit2": "67d8db9252f",
      "commit2_time": "2024-01-30 02:22:42 +0000",
      "commit2_digest": {
        "test_eval[pyhpc_equation_of_state-cpu-jit]": 0.06479158182628453
      }
    }
  ]
}

Bisection workflow link: https://github.com/pytorch/benchmark/actions/runs/7715560263

[xuzhao9]

False positive, closed.