Closed pfultz2 closed 1 month ago
Test | Batch | Rate new 52300a |
Rate old e2e921 |
Diff | Compare | |
---|---|---|---|---|---|---|
torchvision-resnet50 | 64 | 3,260.23 | 3,255.97 | 0.13% | :white_check_mark: | |
torchvision-resnet50_fp16 | 64 | 6,965.49 | 6,971.30 | -0.08% | :white_check_mark: | |
torchvision-densenet121 | 32 | 2,433.89 | 2,431.20 | 0.11% | :white_check_mark: | |
torchvision-densenet121_fp16 | 32 | 4,082.97 | 4,087.45 | -0.11% | :white_check_mark: | |
torchvision-inceptionv3 | 32 | 1,638.74 | 1,635.71 | 0.19% | :white_check_mark: | |
torchvision-inceptionv3_fp16 | 32 | 2,753.83 | 2,755.82 | -0.07% | :white_check_mark: | |
cadene-inceptionv4 | 16 | 779.83 | 780.33 | -0.06% | :white_check_mark: | |
cadene-resnext64x4 | 16 | 808.17 | 806.94 | 0.15% | :white_check_mark: | |
slim-mobilenet | 64 | 7,470.47 | 7,464.88 | 0.07% | :white_check_mark: | |
slim-nasnetalarge | 64 | 208.39 | 208.51 | -0.06% | :white_check_mark: | |
slim-resnet50v2 | 64 | 3,440.47 | 3,435.02 | 0.16% | :white_check_mark: | |
bert-mrpc-onnx | 8 | 1,152.68 | 1,146.59 | 0.53% | :white_check_mark: | |
bert-mrpc-tf | 1 | 321.89 | 318.44 | 1.09% | :white_check_mark: | |
pytorch-examples-wlang-gru | 1 | 384.63 | 421.02 | -8.64% | :red_circle: | |
pytorch-examples-wlang-lstm | 1 | 377.94 | 374.33 | 0.97% | :white_check_mark: | |
torchvision-resnet50_1 | 1 | 771.59 | 803.63 | -3.99% | :red_circle: | |
cadene-dpn92_1 | 1 | 403.01 | 395.85 | 1.81% | :white_check_mark: | |
cadene-resnext101_1 | 1 | 380.51 | 379.14 | 0.36% | :white_check_mark: | |
onnx-taau-downsample | 1 | 366.90 | 366.52 | 0.10% | :white_check_mark: | |
dlrm-criteoterabyte | 1 | 35.06 | 35.01 | 0.13% | :white_check_mark: | |
dlrm-criteoterabyte_fp16 | 1 | 58.17 | 58.19 | -0.03% | :white_check_mark: | |
agentmodel | 1 | 8,020.98 | 8,063.61 | -0.53% | :white_check_mark: | |
unet_fp16 | 2 | 59.03 | 58.95 | 0.14% | :white_check_mark: | |
resnet50v1_fp16 | 1 | 935.78 | 950.25 | -1.52% | :white_check_mark: | |
resnet50v1_int8 | 1 | 962.07 | 971.97 | -1.02% | :white_check_mark: | |
bert_base_cased_fp16 | 64 | 1,170.96 | 1,170.73 | 0.02% | :white_check_mark: | |
bert_large_uncased_fp16 | 32 | 363.74 | 363.46 | 0.08% | :white_check_mark: | |
bert_large_fp16 | 1 | 211.26 | 213.45 | -1.02% | :white_check_mark: | |
distilgpt2_fp16 | 16 | 2,203.93 | 2,199.49 | 0.20% | :white_check_mark: | |
yolov5s | 1 | 543.17 | 539.25 | 0.73% | :white_check_mark: | |
tinyllama | 1 | 43.71 | 43.47 | 0.54% | :white_check_mark: | |
vicuna-fastchat | 1 | 169.94 | 174.86 | -2.81% | :white_check_mark: | |
whisper-tiny-encoder | 1 | 417.56 | 417.66 | -0.03% | :white_check_mark: | |
whisper-tiny-decoder | 1 | 426.79 | 427.92 | -0.26% | :white_check_mark: |
This build is not recommended to merge :red_circle:
:red_circle:bert_large_uncased_fp16: FAILED: MIGraphX is not within tolerance - check verbose output
Reverting this since it broke CI.
Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:
Additional details and impacted files
```diff @@ Coverage Diff @@ ## develop #3497 +/- ## ======================================== Coverage 92.02% 92.02% ======================================== Files 509 509 Lines 21005 21005 ======================================== Hits 19330 19330 Misses 1675 1675 ```:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.