Closed richagadgil closed 1 month ago
Test | Batch | Rate new 63dbab |
Rate old 0d07c2 |
Diff | Compare | |
---|---|---|---|---|---|---|
torchvision-resnet50 | 64 | 3,262.03 | 3,260.52 | 0.05% | :white_check_mark: | |
torchvision-resnet50_fp16 | 64 | 6,994.45 | 6,982.39 | 0.17% | :white_check_mark: | |
torchvision-densenet121 | 32 | 2,433.85 | 2,430.89 | 0.12% | :white_check_mark: | |
torchvision-densenet121_fp16 | 32 | 4,078.93 | 4,067.06 | 0.29% | :white_check_mark: | |
torchvision-inceptionv3 | 32 | 1,639.66 | 1,636.77 | 0.18% | :white_check_mark: | |
torchvision-inceptionv3_fp16 | 32 | 2,763.58 | 2,755.18 | 0.30% | :white_check_mark: | |
cadene-inceptionv4 | 16 | 776.75 | 775.67 | 0.14% | :white_check_mark: | |
cadene-resnext64x4 | 16 | 808.69 | 808.09 | 0.07% | :white_check_mark: | |
slim-mobilenet | 64 | 7,532.50 | 7,531.83 | 0.01% | :white_check_mark: | |
slim-nasnetalarge | 64 | 211.54 | 211.39 | 0.07% | :white_check_mark: | |
slim-resnet50v2 | 64 | 3,502.68 | 3,495.72 | 0.20% | :white_check_mark: | |
bert-mrpc-onnx | 8 | 1,149.07 | 1,140.79 | 0.73% | :white_check_mark: | |
bert-mrpc-tf | 1 | 466.50 | 447.09 | 4.34% | :high_brightness: | |
pytorch-examples-wlang-gru | 1 | 419.36 | 357.24 | 17.39% | :high_brightness: | |
pytorch-examples-wlang-lstm | 1 | 393.79 | 320.71 | 22.78% | :high_brightness: | |
torchvision-resnet50_1 | 1 | 809.68 | 776.99 | 4.21% | :high_brightness: | |
cadene-dpn92_1 | 1 | 410.95 | 430.45 | -4.53% | :red_circle: | |
cadene-resnext101_1 | 1 | 382.91 | 378.42 | 1.19% | :white_check_mark: | |
onnx-taau-downsample | 1 | 343.00 | 341.70 | 0.38% | :white_check_mark: | |
dlrm-criteoterabyte | 1 | 33.33 | 32.05 | 3.99% | :high_brightness: | |
dlrm-criteoterabyte_fp16 | 1 | 52.78 | 50.61 | 4.27% | :high_brightness: | |
agentmodel | 1 | 8,584.58 | 6,696.76 | 28.19% | :high_brightness: | |
unet_fp16 | 2 | 58.84 | 58.59 | 0.44% | :white_check_mark: | |
resnet50v1_fp16 | 1 | 935.84 | 840.65 | 11.32% | :high_brightness: | |
resnet50v1_int8 | 1 | 980.92 | 931.26 | 5.33% | :high_brightness: | |
bert_base_cased_fp16 | 64 | 1,171.17 | 1,170.54 | 0.05% | :white_check_mark: | |
bert_large_uncased_fp16 | 32 | 363.64 | 363.52 | 0.03% | :white_check_mark: | |
bert_large_fp16 | 1 | 198.79 | 196.02 | 1.42% | :white_check_mark: | |
distilgpt2_fp16 | 16 | 2,201.46 | 2,199.51 | 0.09% | :white_check_mark: | |
yolov5s | 1 | 542.68 | 536.04 | 1.24% | :white_check_mark: | |
tinyllama | 1 | 43.46 | 43.33 | 0.30% | :white_check_mark: | |
vicuna-fastchat | 1 | 177.67 | 171.81 | 3.41% | :high_brightness: | |
whisper-tiny-encoder | 1 | 418.24 | 416.70 | 0.37% | :white_check_mark: | |
whisper-tiny-decoder | 1 | 428.48 | 418.85 | 2.30% | :white_check_mark: |
This build is not recommended to merge :red_circle:
:red_circle:bert_large_uncased_fp16: FAILED: MIGraphX is not within tolerance - check verbose output
Prints out environment variables that contain "MIGRAPHX" as follows:
Running [ MIGraphX Version: 2.11.0.b9fe9158f-dirty ]: /code/AMDMIGraphX/build/bin/migraphx-driver perf models/rnnt/rnnt_joint/model.onnx
MIGRAPHX_123=y
MIGRAPHX_ABC=1
Compiling ...
Reading: models/rnnt/rnnt_joint/model.onnx
# MIGRAPHX_1=1 MIGRAPHX_2=y /code/AMDMIGraphX/build/bin/migraphx-driver perf models/rnnt/rnnt_joint/mod
el.onnx
Running [ MIGraphX Version: 2.11.0.b9fe9158f-dirty ]: /code/AMDMIGraphX/build/bin/migraphx-driver perf models/rnnt/rnnt_joint/model.onnx
MIGRAPHX_2=y
MIGRAPHX_1=1
MIGRAPHX_123=y
MIGRAPHX_ABC=1
Compiling ...
Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:
Additional details and impacted files
```diff @@ Coverage Diff @@ ## develop #3514 +/- ## ======================================== Coverage 92.05% 92.05% ======================================== Files 509 509 Lines 21014 21014 ======================================== Hits 19345 19345 Misses 1669 1669 ```:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.