[TorchBench] Performance Signal Detected

TorchBench CI has detected a performance signal.

Affected Tests:

eval-cuda-fp32:
- attention_is_all_you_need_pytorch[dynamo-blade (latency)] 5.893 -> 6.651, -12.8627%
- attention_is_all_you_need_pytorch[dynamo-disc (latency)] 4.955 -> 5.519, -11.3824%
- BERT_pytorch[dynamo-disc (latency)] 26.208 -> 46.422, -77.1291%
- BERT_pytorch[disc (compiled)] 1217 -> 0
- BERT_pytorch[disc (clusters)] 1 -> 0
- BERT_pytorch[dynamo-disc (clusters)] 1 -> 0
- BERT_pytorch[dynamo-disc (compiled)] 1170 -> 0
- DALLE2_pytorch[disc (compiled)] 22395 -> 22800
- DALLE2_pytorch[disc (clusters)] 161 -> 184
- fambench_xlmr[dynamo-disc (compiled)] 3012 -> 2868
- functorch_maml_omniglot[blade (latency)] 0.56 -> 0.593, -5.8929%
- hf_Bart[dynamo-blade (latency)] 9.695 -> 12.112, -24.9304%
- hf_Bart[dynamo-disc (latency)] 10.227 -> 12.778, -24.9438%
- hf_Bart[dynamo-disc (clusters)] 1 -> 8
- hf_Bart[dynamo-disc (compiled)] 1426 -> 1414
- hf_Bert[dynamo-blade (latency)] 6.888 -> 8.053, -16.9135%
- hf_Bert[dynamo-disc (latency)] 7.256 -> 8.25, -13.699%
- hf_Bert_large[dynamo-blade (latency)] 18.071 -> 19.414, -7.4318%
- hf_Bert_large[dynamo-disc (latency)] 19.601 -> 21.054, -7.4129%
- hf_Bert_mini[dynamo-blade (latency)] 0.562 -> 1.007, -79.1815%
- hf_Bert_mini[dynamo-disc (latency)] 0.866 -> 1.45, -67.4365%
- hf_DistilBert[dynamo-blade (latency)] 3.684 -> 4.118, -11.7807%
- hf_DistilBert[dynamo-disc (latency)] 4.034 -> 4.345, -7.7095%
- hf_Longformer[dynamo-disc (latency)] 105.792 -> 119.491, -12.949%
- hf_T5_large[dynamo-blade (latency)] 100.251 -> 105.483, -5.2189%
- maml_omniglot[dynamo-blade (latency)] 0.457 -> 0.483, -5.6893%
- mobilenet_v3_large[disc (compiled)] 580 -> 590
- mobilenet_v3_large[disc (clusters)] 9 -> 10
- mobilenet_v3_large[dynamo-disc (clusters)] 9 -> 10
- mobilenet_v3_large[dynamo-disc (compiled)] 580 -> 590
- phlippe_densenet[dynamo-blade (latency)] 6.224 -> 6.562, -5.4306%
- phlippe_resnet[disc (latency)] 2.46 -> 2.212, +10.0813%
- resnet18[dynamo-blade (latency)] 2.005 -> 2.127, -6.0848%
- soft_actor_critic[dynamo-blade (latency)] status changed, 5.333 -> TypeError
- soft_actor_critic[dynamo-disc (latency)] status changed, 5.27 -> TypeError
- soft_actor_critic[dynamo-disc (clusters)] status changed, 1.0 -> N/A
- soft_actor_critic[dynamo-disc (compiled)] status changed, 25.0 -> N/A
- Super_SloMo[disc (latency)] status changed, RuntimeError -> 122.264
- Super_SloMo[dynamo-disc (latency)] status changed, RuntimeError -> 122.784
- Super_SloMo[disc (compiled)] status changed, N/A -> 1351.0
- Super_SloMo[disc (clusters)] status changed, N/A -> 32.0
- Super_SloMo[dynamo-disc (clusters)] status changed, N/A -> 32.0
- Super_SloMo[dynamo-disc (compiled)] status changed, N/A -> 1351.0
- timm_vovnet[dynamo-blade (latency)] 20.534 -> 22.111, -7.6799%
- yolov3[disc (latency)] 41.283 -> 37.144, +10.0259%

detail data can be seen in oss://bladedisc-ci/TorchBench/full/20230415-17 created by TorchBench CI automatically

alibaba / BladeDISC

[TorchBench] Performance Signal Detected #1122