Closed pfultz2 closed 2 days ago
Test | Batch | Rate new f2e2f9 |
Rate old c51bea |
Diff | Compare | |
---|---|---|---|---|---|---|
torchvision-resnet50 | 64 | 3,261.10 | 3,257.81 | 0.10% | :white_check_mark: | |
torchvision-resnet50_fp16 | 64 | 6,988.97 | 6,987.81 | 0.02% | :white_check_mark: | |
torchvision-densenet121 | 32 | 2,435.78 | 2,434.57 | 0.05% | :white_check_mark: | |
torchvision-densenet121_fp16 | 32 | 4,089.51 | 4,065.61 | 0.59% | :white_check_mark: | |
torchvision-inceptionv3 | 32 | 1,628.32 | 1,637.17 | -0.54% | :white_check_mark: | |
torchvision-inceptionv3_fp16 | 32 | 2,746.64 | 2,759.26 | -0.46% | :white_check_mark: | |
cadene-inceptionv4 | 16 | 764.15 | 776.31 | -1.57% | :white_check_mark: | |
cadene-resnext64x4 | 16 | 806.80 | 811.75 | -0.61% | :white_check_mark: | |
slim-mobilenet | 64 | 7,465.46 | 7,533.16 | -0.90% | :white_check_mark: | |
slim-nasnetalarge | 64 | 208.40 | 211.39 | -1.41% | :white_check_mark: | |
slim-resnet50v2 | 64 | 3,438.86 | 3,504.83 | -1.88% | :white_check_mark: | |
bert-mrpc-onnx | 8 | 1,151.60 | 1,146.47 | 0.45% | :white_check_mark: | |
bert-mrpc-tf | 1 | 468.18 | 473.89 | -1.21% | :white_check_mark: | |
pytorch-examples-wlang-gru | 1 | 425.12 | 425.31 | -0.04% | :white_check_mark: | |
pytorch-examples-wlang-lstm | 1 | 384.16 | 408.68 | -6.00% | :red_circle: | |
torchvision-resnet50_1 | 1 | 786.18 | 771.75 | 1.87% | :white_check_mark: | |
cadene-dpn92_1 | 1 | 399.58 | 399.01 | 0.14% | :white_check_mark: | |
cadene-resnext101_1 | 1 | 384.59 | 383.85 | 0.19% | :white_check_mark: | |
onnx-taau-downsample | 1 | 345.54 | 343.09 | 0.71% | :white_check_mark: | |
dlrm-criteoterabyte | 1 | 33.33 | 33.31 | 0.06% | :white_check_mark: | |
dlrm-criteoterabyte_fp16 | 1 | 52.73 | 52.71 | 0.05% | :white_check_mark: | |
agentmodel | 1 | 8,324.94 | 8,235.67 | 1.08% | :white_check_mark: | |
unet_fp16 | 2 | 58.83 | 58.90 | -0.12% | :white_check_mark: | |
resnet50v1_fp16 | 1 | 1,020.60 | 940.89 | 8.47% | :high_brightness: | |
resnet50v1_int8 | 1 | 1,017.56 | 1,025.93 | -0.82% | :white_check_mark: | |
bert_base_cased_fp16 | 64 | 1,169.33 | 1,170.88 | -0.13% | :white_check_mark: | |
bert_large_uncased_fp16 | 32 | 363.36 | 363.69 | -0.09% | :white_check_mark: | |
bert_large_fp16 | 1 | 198.83 | 200.14 | -0.65% | :white_check_mark: | |
distilgpt2_fp16 | 16 | 2,202.02 | 2,200.77 | 0.06% | :white_check_mark: | |
yolov5s | 1 | 533.35 | 535.15 | -0.34% | :white_check_mark: | |
tinyllama | 1 | 43.71 | 43.41 | 0.69% | :white_check_mark: | |
vicuna-fastchat | 1 | 175.59 | 178.09 | -1.41% | :white_check_mark: | |
whisper-tiny-encoder | 1 | 415.37 | 418.18 | -0.67% | :white_check_mark: | |
whisper-tiny-decoder | 1 | 426.80 | 427.58 | -0.18% | :white_check_mark: |
This build is not recommended to merge :red_circle:
:red_circle:bert_large_uncased_fp16: FAILED: MIGraphX is not within tolerance - check verbose output
Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:
Additional details and impacted files
```diff @@ Coverage Diff @@ ## develop #3609 +/- ## =========================================== - Coverage 92.17% 92.17% -0.01% =========================================== Files 513 513 Lines 21560 21558 -2 =========================================== - Hits 19873 19871 -2 Misses 1687 1687 ```:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.