Closed pfultz2 closed 1 week ago
Test | Batch | Rate new 5efabe |
Rate old 7c2fdf |
Diff | Compare | |
---|---|---|---|---|---|---|
torchvision-resnet50 | 64 | 3,252.23 | 3,249.19 | 0.09% | :white_check_mark: | |
torchvision-resnet50_fp16 | 64 | 6,989.90 | 6,993.27 | -0.05% | :white_check_mark: | |
torchvision-densenet121 | 32 | 2,433.79 | 2,434.31 | -0.02% | :white_check_mark: | |
torchvision-densenet121_fp16 | 32 | 4,061.38 | 4,095.02 | -0.82% | :white_check_mark: | |
torchvision-inceptionv3 | 32 | 1,636.41 | 1,635.79 | 0.04% | :white_check_mark: | |
torchvision-inceptionv3_fp16 | 32 | 2,739.77 | 2,740.83 | -0.04% | :white_check_mark: | |
cadene-inceptionv4 | 16 | 777.34 | 776.76 | 0.07% | :white_check_mark: | |
cadene-resnext64x4 | 16 | 809.12 | 808.72 | 0.05% | :white_check_mark: | |
slim-mobilenet | 64 | 7,460.25 | 7,455.28 | 0.07% | :white_check_mark: | |
slim-nasnetalarge | 64 | 208.56 | 208.38 | 0.09% | :white_check_mark: | |
slim-resnet50v2 | 64 | 3,434.60 | 3,435.08 | -0.01% | :white_check_mark: | |
bert-mrpc-onnx | 8 | 1,145.27 | 1,150.34 | -0.44% | :white_check_mark: | |
bert-mrpc-tf | 1 | 309.87 | 314.36 | -1.43% | :white_check_mark: | |
pytorch-examples-wlang-gru | 1 | 413.42 | 418.46 | -1.20% | :white_check_mark: | |
pytorch-examples-wlang-lstm | 1 | 382.45 | 499.68 | -23.46% | :red_circle: | |
torchvision-resnet50_1 | 1 | 814.50 | 772.72 | 5.41% | :high_brightness: | |
cadene-dpn92_1 | 1 | 432.72 | 397.74 | 8.80% | :high_brightness: | |
cadene-resnext101_1 | 1 | 383.64 | 383.61 | 0.01% | :white_check_mark: | |
onnx-taau-downsample | 1 | 344.49 | 344.76 | -0.08% | :white_check_mark: | |
dlrm-criteoterabyte | 1 | 32.90 | 35.10 | -6.27% | :red_circle: | |
dlrm-criteoterabyte_fp16 | 1 | 53.63 | 58.12 | -7.73% | :red_circle: | |
agentmodel | 1 | 7,834.17 | 7,932.67 | -1.24% | :white_check_mark: | |
unet_fp16 | 2 | 58.06 | 57.85 | 0.36% | :white_check_mark: | |
resnet50v1_fp16 | 1 | 940.32 | 935.68 | 0.50% | :white_check_mark: | |
resnet50v1_int8 | 1 | 1,006.79 | 949.99 | 5.98% | :high_brightness: | |
bert_base_cased_fp16 | 64 | 1,153.39 | 1,153.06 | 0.03% | :white_check_mark: | |
bert_large_uncased_fp16 | 32 | 355.70 | 355.77 | -0.02% | :white_check_mark: | |
bert_large_fp16 | 1 | 209.85 | 210.32 | -0.23% | :white_check_mark: | |
distilgpt2_fp16 | 16 | 2,160.43 | 2,161.65 | -0.06% | :white_check_mark: | |
yolov5s | 1 | 537.83 | 534.27 | 0.67% | :white_check_mark: | |
tinyllama | 1 | 43.23 | 43.40 | -0.39% | :white_check_mark: | |
vicuna-fastchat | 1 | 172.35 | 170.43 | 1.13% | :white_check_mark: | |
whisper-tiny-encoder | 1 | 417.05 | 418.17 | -0.27% | :white_check_mark: | |
whisper-tiny-decoder | 1 | 431.27 | 426.09 | 1.22% | :white_check_mark: |
This build is not recommended to merge :red_circle:
:red_circle:bert_large_uncased_fp16: FAILED: MIGraphX is not within tolerance - check verbose output
Performance is all over the place. I can't merge this without some more feedback
Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:
Additional details and impacted files
```diff @@ Coverage Diff @@ ## develop #3451 +/- ## ========================================= Coverage 92.04% 92.05% ========================================= Files 505 506 +1 Lines 20699 20837 +138 ========================================= + Hits 19052 19181 +129 - Misses 1647 1656 +9 ```:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.