Closed github-actions[bot] closed 1 week ago
All modified and coverable lines are covered by tests :white_check_mark:
Project coverage is 92.16%. Comparing base (
5388984
) to head (42f8d9c
). Report is 2 commits behind head on develop.
:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.
Test | Batch | Rate new 42f8d9 |
Rate old 77ab44 |
Diff | Compare | |
---|---|---|---|---|---|---|
torchvision-resnet50 | 64 | 3,258.89 | 3,259.78 | -0.03% | :white_check_mark: | |
torchvision-resnet50_fp16 | 64 | 6,973.85 | 6,995.97 | -0.32% | :white_check_mark: | |
torchvision-densenet121 | 32 | 2,433.65 | 2,436.42 | -0.11% | :white_check_mark: | |
torchvision-densenet121_fp16 | 32 | 4,098.64 | 4,071.94 | 0.66% | :white_check_mark: | |
torchvision-inceptionv3 | 32 | 1,637.99 | 1,639.03 | -0.06% | :white_check_mark: | |
torchvision-inceptionv3_fp16 | 32 | 2,765.89 | 2,763.00 | 0.10% | :white_check_mark: | |
cadene-inceptionv4 | 16 | 776.42 | 776.59 | -0.02% | :white_check_mark: | |
cadene-resnext64x4 | 16 | 810.95 | 808.43 | 0.31% | :white_check_mark: | |
slim-mobilenet | 64 | 7,535.53 | 7,532.81 | 0.04% | :white_check_mark: | |
slim-nasnetalarge | 64 | 211.52 | 211.50 | 0.01% | :white_check_mark: | |
slim-resnet50v2 | 64 | 3,505.35 | 3,504.45 | 0.03% | :white_check_mark: | |
bert-mrpc-onnx | 8 | 1,153.90 | 1,150.80 | 0.27% | :white_check_mark: | |
bert-mrpc-tf | 1 | 506.93 | 464.16 | 9.22% | :high_brightness: | |
pytorch-examples-wlang-gru | 1 | 418.86 | 424.10 | -1.23% | :white_check_mark: | |
pytorch-examples-wlang-lstm | 1 | 383.60 | 397.87 | -3.58% | :red_circle: | |
torchvision-resnet50_1 | 1 | 765.24 | 817.55 | -6.40% | :red_circle: | |
cadene-dpn92_1 | 1 | 400.33 | 436.30 | -8.24% | :red_circle: | |
cadene-resnext101_1 | 1 | 383.61 | 374.14 | 2.53% | :white_check_mark: | |
onnx-taau-downsample | 1 | 342.97 | 343.01 | -0.01% | :white_check_mark: | |
dlrm-criteoterabyte | 1 | 33.33 | 33.36 | -0.08% | :white_check_mark: | |
dlrm-criteoterabyte_fp16 | 1 | 52.71 | 52.73 | -0.05% | :white_check_mark: | |
agentmodel | 1 | 8,423.75 | 8,198.74 | 2.74% | :white_check_mark: | |
unet_fp16 | 2 | 58.96 | 58.86 | 0.17% | :white_check_mark: | |
resnet50v1_fp16 | 1 | 940.70 | 987.67 | -4.76% | :red_circle: | |
resnet50v1_int8 | 1 | 1,006.48 | 991.53 | 1.51% | :white_check_mark: | |
bert_base_cased_fp16 | 64 | 1,172.23 | 1,171.75 | 0.04% | :white_check_mark: | |
bert_large_uncased_fp16 | 32 | 363.90 | 363.44 | 0.13% | :white_check_mark: | |
bert_large_fp16 | 1 | 199.95 | 198.74 | 0.61% | :white_check_mark: | |
distilgpt2_fp16 | 16 | 2,200.79 | 2,194.99 | 0.26% | :white_check_mark: | |
yolov5s | 1 | 540.63 | 538.41 | 0.41% | :white_check_mark: | |
tinyllama | 1 | 43.76 | 43.41 | 0.80% | :white_check_mark: | |
vicuna-fastchat | 1 | 171.44 | 174.43 | -1.71% | :white_check_mark: | |
whisper-tiny-encoder | 1 | 416.32 | 418.43 | -0.50% | :white_check_mark: | |
whisper-tiny-decoder | 1 | 429.14 | 426.61 | 0.59% | :white_check_mark: |
This build is not recommended to merge :red_circle:
:red_circle:bert_large_uncased_fp16: FAILED: MIGraphX is not within tolerance - check verbose output
Update CI point for Onnxruntime builds