Closed TedThemistokleous closed 3 days ago
Test | Batch | Rate new 45e73d |
Rate old ab5da3 |
Diff | Compare | |
---|---|---|---|---|---|---|
torchvision-resnet50 | 64 | 3,251.49 | 3,250.20 | 0.04% | :white_check_mark: | |
torchvision-resnet50_fp16 | 64 | 6,994.07 | 6,981.72 | 0.18% | :white_check_mark: | |
torchvision-densenet121 | 32 | 2,429.29 | 2,434.35 | -0.21% | :white_check_mark: | |
torchvision-densenet121_fp16 | 32 | 4,093.53 | 4,104.80 | -0.27% | :white_check_mark: | |
torchvision-inceptionv3 | 32 | 1,638.17 | 1,637.98 | 0.01% | :white_check_mark: | |
torchvision-inceptionv3_fp16 | 32 | 2,741.25 | 2,743.88 | -0.10% | :white_check_mark: | |
cadene-inceptionv4 | 16 | 779.48 | 778.58 | 0.12% | :white_check_mark: | |
cadene-resnext64x4 | 16 | 808.33 | 808.70 | -0.05% | :white_check_mark: | |
slim-mobilenet | 64 | 7,455.11 | 7,457.95 | -0.04% | :white_check_mark: | |
slim-nasnetalarge | 64 | 208.27 | 208.52 | -0.12% | :white_check_mark: | |
slim-resnet50v2 | 64 | 3,435.50 | 3,435.85 | -0.01% | :white_check_mark: | |
bert-mrpc-onnx | 8 | 1,151.30 | 1,153.18 | -0.16% | :white_check_mark: | |
bert-mrpc-tf | 1 | 308.62 | 305.52 | 1.02% | :white_check_mark: | |
pytorch-examples-wlang-gru | 1 | 472.20 | 384.89 | 22.68% | :high_brightness: | |
pytorch-examples-wlang-lstm | 1 | 373.71 | 386.28 | -3.25% | :red_circle: | |
torchvision-resnet50_1 | 1 | 778.06 | 768.57 | 1.24% | :white_check_mark: | |
cadene-dpn92_1 | 1 | 395.86 | 437.45 | -9.51% | :red_circle: | |
cadene-resnext101_1 | 1 | 381.57 | 383.50 | -0.50% | :white_check_mark: | |
onnx-taau-downsample | 1 | 344.50 | 344.79 | -0.08% | :white_check_mark: | |
dlrm-criteoterabyte | 1 | 35.07 | 35.03 | 0.12% | :white_check_mark: | |
dlrm-criteoterabyte_fp16 | 1 | 58.04 | 58.06 | -0.02% | :white_check_mark: | |
agentmodel | 1 | 7,979.19 | 7,924.68 | 0.69% | :white_check_mark: | |
unet_fp16 | 2 | 57.90 | 57.94 | -0.06% | :white_check_mark: | |
resnet50v1_fp16 | 1 | 945.28 | 929.40 | 1.71% | :white_check_mark: | |
resnet50v1_int8 | 1 | 951.78 | 960.30 | -0.89% | :white_check_mark: | |
bert_base_cased_fp16 | 64 | 1,153.86 | 1,153.43 | 0.04% | :white_check_mark: | |
bert_large_uncased_fp16 | 32 | 355.85 | 355.83 | 0.01% | :white_check_mark: | |
bert_large_fp16 | 1 | 210.72 | 210.44 | 0.13% | :white_check_mark: | |
distilgpt2_fp16 | 16 | 2,158.86 | 2,159.20 | -0.02% | :white_check_mark: | |
yolov5s | 1 | 536.14 | 539.05 | -0.54% | :white_check_mark: | |
tinyllama | 1 | 43.39 | 43.40 | -0.03% | :white_check_mark: | |
vicuna-fastchat | 1 | 174.45 | 170.95 | 2.04% | :white_check_mark: | |
whisper-tiny-encoder | 1 | 418.22 | 417.95 | 0.06% | :white_check_mark: | |
whisper-tiny-decoder | 1 | 422.62 | 423.97 | -0.32% | :white_check_mark: |
This build is not recommended to merge :red_circle:
:red_circle:bert_large_uncased_fp16: FAILED: MIGraphX is not within tolerance - check verbose output
Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:
Additional details and impacted files
```diff @@ Coverage Diff @@ ## develop #3469 +/- ## ======================================== Coverage 92.04% 92.04% ======================================== Files 506 506 Lines 20872 20872 ======================================== Hits 19212 19212 Misses 1660 1660 ``` | [Flag](https://app.codecov.io/gh/ROCm/AMDMIGraphX/pull/3469/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ROCm) | Coverage Δ | | |---|---|---| | [](https://app.codecov.io/gh/ROCm/AMDMIGraphX/pull/3469/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ROCm) | `92.04% <ø> (ø)` | | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ROCm#carryforward-flags-in-the-pull-request-comment) to find out more.:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.