[TorchBench] Performance Signal Detected

TorchBench CI has detected a performance signal.

Affected Tests:

eval-cuda-fp32:
- attention_is_all_you_need_pytorch[dynamo-blade (latency)] 5.893 -> 6.688, -13.4906%
- attention_is_all_you_need_pytorch[dynamo-disc (latency)] 4.955 -> 5.598, -12.9768%
- DALLE2_pytorch[disc (latency)] 97.537 -> 89.964, +7.7642%
- DALLE2_pytorch[disc (compiled)] 22395 -> 22800
- DALLE2_pytorch[disc (clusters)] 161 -> 184
- drq[dynamo-blade (latency)] 1.388 -> 1.296, +6.6282%
- fambench_xlmr[dynamo-disc (compiled)] 3012 -> 2868
- functorch_dp_cifar10[disc (latency)] 2.093 -> 1.688, +19.3502%
- functorch_dp_cifar10[dynamo-disc (latency)] 2.163 -> 1.961, +9.3389%
- hf_Bart[dynamo-blade (latency)] 9.695 -> 12.179, -25.6215%
- hf_Bart[dynamo-disc (latency)] 10.227 -> 12.729, -24.4647%
- hf_Bart[dynamo-disc (clusters)] 1 -> 8
- hf_Bart[dynamo-disc (compiled)] 1426 -> 1414
- hf_Bert[dynamo-blade (latency)] 6.888 -> 7.969, -15.694%
- hf_Bert[dynamo-disc (latency)] 7.256 -> 8.192, -12.8997%
- hf_Bert_large[dynamo-blade (latency)] 18.071 -> 19.838, -9.7781%
- hf_Bert_large[dynamo-disc (latency)] 19.601 -> 21.149, -7.8976%
- hf_Bert_mini[dynamo-blade (latency)] 0.562 -> 1.016, -80.7829%
- hf_Bert_mini[dynamo-disc (latency)] 0.866 -> 1.441, -66.3972%
- hf_DistilBert[dynamo-blade (latency)] 3.684 -> 4.136, -12.2693%
- hf_DistilBert[dynamo-disc (latency)] 4.034 -> 4.359, -8.0565%
- hf_GPT2[dynamo-blade (latency)] 21.082 -> 22.155, -5.0896%
- hf_Longformer[dynamo-disc (latency)] 105.792 -> 119.07, -12.551%
- hf_T5_large[dynamo-blade (latency)] 100.251 -> 105.395, -5.1311%
- maml_omniglot[dynamo-blade (latency)] 0.457 -> 0.492, -7.6586%
- mobilenet_v3_large[disc (compiled)] 580 -> 590
- mobilenet_v3_large[disc (clusters)] 9 -> 10
- mobilenet_v3_large[dynamo-disc (clusters)] 9 -> 10
- mobilenet_v3_large[dynamo-disc (compiled)] 580 -> 590
- phlippe_resnet[dynamo-disc (latency)] 2.474 -> 2.625, -6.1035%
- soft_actor_critic[dynamo-blade (latency)] status changed, 5.333 -> TypeError
- soft_actor_critic[dynamo-disc (latency)] status changed, 5.27 -> TypeError
- soft_actor_critic[dynamo-disc (clusters)] status changed, 1.0 -> N/A
- soft_actor_critic[dynamo-disc (compiled)] status changed, 25.0 -> N/A
- Super_SloMo[disc (latency)] status changed, RuntimeError -> 122.326
- Super_SloMo[dynamo-disc (latency)] status changed, RuntimeError -> 122.599
- Super_SloMo[disc (compiled)] status changed, N/A -> 1351.0
- Super_SloMo[disc (clusters)] status changed, N/A -> 32.0
- Super_SloMo[dynamo-disc (clusters)] status changed, N/A -> 32.0
- Super_SloMo[dynamo-disc (compiled)] status changed, N/A -> 1351.0
- timm_vovnet[dynamo-blade (latency)] 20.534 -> 22.059, -7.4267%
- yolov3[disc (latency)] 41.283 -> 37.066, +10.2149%

detail data can be seen in oss://bladedisc-ci/TorchBench/full/20230421-15 created by TorchBench CI automatically

alibaba / BladeDISC

[TorchBench] Performance Signal Detected #1130