Performance Signal Detected by TorchBench CI on '1.12.0.dev20220405+cu113'

[github-actions[bot]]

TorchBench CI has detected a performance signal.

Base PyTorch version: 1.12.0.dev20220403+cu113

Base PyTorch commit: bd032cd8d65e36b9d16af42520f5d63e861cb9d4

Affected PyTorch version: 1.12.0.dev20220405+cu113

Affected PyTorch commit: b0e047b59da4d6434bf347dd6ae501169218bb1a

Affected Tests:

• test_train[Super_SloMo-cuda-jit]: -16.88734%
• test_eval[Super_SloMo-cuda-jit]: +12.23077%
• test_train[Super_SloMo-cuda-eager]: -16.81555%
• test_eval[Super_SloMo-cuda-eager]: +12.08973%
• test_eval[alexnet-cuda-jit]: -13.94041%
• test_eval[alexnet-cuda-eager]: -13.07031%
• test_train[densenet121-cuda-jit]: -8.04015%
• test_train[densenet121-cuda-eager]: -7.95190%
• test_eval[densenet121-cuda-eager]: -7.07512%
• test_train[maml-cuda-eager]: -12.91613%
• test_eval[maml-cuda-eager]: -13.65270%
• test_eval[mnasnet1_0-cuda-jit]: -94.54541%
• test_train[mobilenet_v2-cuda-jit]: -10.56092%
• test_eval[mobilenet_v2-cuda-jit]: -12.50417%
• test_train[mobilenet_v2-cuda-eager]: -10.55601%
• test_eval[mobilenet_v2-cuda-eager]: -7.39146%
• test_eval[mobilenet_v3_large-cuda-jit]: -21.50287%
• test_train[moco-cuda-jit]: -9.83134%
• test_train[moco-cuda-eager]: -9.80068%
• test_eval[opacus_cifar10-cuda-eager]: -27.63870%
• test_eval[pytorch_stargan-cuda-jit]: -30.44466%
• test_eval[pytorch_stargan-cuda-eager]: -30.47270%
• test_train[resnet18-cuda-jit]: -17.19763%
• test_train[resnet18-cuda-eager]: -17.29127%
• test_train[resnet50-cuda-jit]: -16.88958%
• test_eval[resnet50-cuda-jit]: -20.29944%
• test_train[resnet50-cuda-eager]: -16.84506%
• test_eval[resnet50-cuda-eager]: -9.26120%
• test_train[resnet50_quantized_qat-cuda-eager]: -12.04411%
• test_train[resnext50_32x4d-cuda-jit]: -18.92614%
• test_train[resnext50_32x4d-cuda-eager]: -18.85035%
• test_eval[resnext50_32x4d-cuda-eager]: -9.40264%
• test_eval[shufflenet_v2_x1_0-cuda-jit]: +8.64341%
• test_train[squeezenet1_1-cuda-jit]: -10.69087%
• test_eval[squeezenet1_1-cuda-jit]: -8.07538%
• test_train[squeezenet1_1-cuda-eager]: -10.74510%
• test_eval[squeezenet1_1-cuda-eager]: -8.71605%
• test_train[timm_resnest-cuda-jit]: -34.31089%
• test_eval[timm_resnest-cuda-jit]: -7.79768%
• test_train[timm_resnest-cuda-eager]: -34.35969%
• test_eval[timm_resnest-cuda-eager]: -7.83851%
• test_train[vgg16-cuda-jit]: -9.49614%
• test_train[vgg16-cuda-eager]: -9.56612%

cc @xuzhao9

[xuzhao9]

Again this is because of infra issue . Closed.