Closed richagadgil closed 3 days ago
Test | Batch | Rate new 9eb660 |
Rate old 4b96e1 |
Diff | Compare | |
---|---|---|---|---|---|---|
torchvision-resnet50 | 64 | 3,258.82 | 3,260.40 | -0.05% | :white_check_mark: | |
torchvision-resnet50_fp16 | 64 | 6,990.79 | 6,981.88 | 0.13% | :white_check_mark: | |
torchvision-densenet121 | 32 | 2,435.52 | 2,436.50 | -0.04% | :white_check_mark: | |
torchvision-densenet121_fp16 | 32 | 4,079.37 | 4,081.96 | -0.06% | :white_check_mark: | |
torchvision-inceptionv3 | 32 | 1,638.67 | 1,638.04 | 0.04% | :white_check_mark: | |
torchvision-inceptionv3_fp16 | 32 | 2,760.72 | 2,760.86 | -0.01% | :white_check_mark: | |
cadene-inceptionv4 | 16 | 776.57 | 776.56 | 0.00% | :white_check_mark: | |
cadene-resnext64x4 | 16 | 807.69 | 811.67 | -0.49% | :white_check_mark: | |
slim-mobilenet | 64 | 7,536.08 | 7,540.50 | -0.06% | :white_check_mark: | |
slim-nasnetalarge | 64 | 211.47 | 211.49 | -0.01% | :white_check_mark: | |
slim-resnet50v2 | 64 | 3,503.45 | 3,506.73 | -0.09% | :white_check_mark: | |
bert-mrpc-onnx | 8 | 1,146.66 | 1,147.08 | -0.04% | :white_check_mark: | |
bert-mrpc-tf | 1 | 464.74 | 465.87 | -0.24% | :white_check_mark: | |
pytorch-examples-wlang-gru | 1 | 423.38 | 423.73 | -0.08% | :white_check_mark: | |
pytorch-examples-wlang-lstm | 1 | 405.37 | 389.07 | 4.19% | :high_brightness: | |
torchvision-resnet50_1 | 1 | 776.93 | 788.22 | -1.43% | :white_check_mark: | |
cadene-dpn92_1 | 1 | 397.68 | 402.19 | -1.12% | :white_check_mark: | |
cadene-resnext101_1 | 1 | 383.08 | 382.83 | 0.06% | :white_check_mark: | |
onnx-taau-downsample | 1 | 343.31 | 343.07 | 0.07% | :white_check_mark: | |
dlrm-criteoterabyte | 1 | 33.34 | 33.34 | -0.00% | :white_check_mark: | |
dlrm-criteoterabyte_fp16 | 1 | 52.72 | 52.75 | -0.06% | :white_check_mark: | |
agentmodel | 1 | 8,188.13 | 8,325.15 | -1.65% | :white_check_mark: | |
unet_fp16 | 2 | 58.90 | 58.80 | 0.18% | :white_check_mark: | |
resnet50v1_fp16 | 1 | 933.56 | 953.06 | -2.05% | :white_check_mark: | |
resnet50v1_int8 | 1 | 1,020.03 | 1,005.99 | 1.40% | :white_check_mark: | |
bert_base_cased_fp16 | 64 | 1,170.77 | 1,170.44 | 0.03% | :white_check_mark: | |
bert_large_uncased_fp16 | 32 | 363.54 | 363.37 | 0.05% | :white_check_mark: | |
bert_large_fp16 | 1 | 200.46 | 198.99 | 0.74% | :white_check_mark: | |
distilgpt2_fp16 | 16 | 2,204.62 | 2,201.23 | 0.15% | :white_check_mark: | |
yolov5s | 1 | 537.68 | 536.00 | 0.31% | :white_check_mark: | |
tinyllama | 1 | 43.45 | 43.45 | 0.02% | :white_check_mark: | |
vicuna-fastchat | 1 | 171.01 | 174.10 | -1.78% | :white_check_mark: | |
whisper-tiny-encoder | 1 | 418.45 | 418.74 | -0.07% | :white_check_mark: | |
whisper-tiny-decoder | 1 | 428.69 | 425.97 | 0.64% | :white_check_mark: |
Check results before merge :high_brightness:
:red_circle:bert_large_uncased_fp16: FAILED: MIGraphX is not within tolerance - check verbose output
Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:
Additional details and impacted files
```diff @@ Coverage Diff @@ ## develop #3604 +/- ## =========================================== - Coverage 92.18% 92.17% -0.01% =========================================== Files 513 513 Lines 21548 21560 +12 =========================================== + Hits 19863 19873 +10 - Misses 1685 1687 +2 ```:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.