Closed github-actions[bot] closed 3 days ago
model | DEFAULT | MLIR_EXTENDED |
---|---|---|
bert-mrpc-onnx | :white_check_mark: | :red_circle: |
bert-mrpc-tf | :white_check_mark: | :white_check_mark: |
pytorch-examples-wlang-gru | :white_check_mark: | :white_check_mark: |
pytorch-examples-wlang-lstm | :white_check_mark: | :white_check_mark: |
torchvision-resnet50_1 | :white_check_mark: | :white_check_mark: |
cadene-dpn92_1 | :white_check_mark: | :white_check_mark: |
cadene-resnext101_1 | :white_check_mark: | :white_check_mark: |
dlrm-criteoterabyte | :white_check_mark: | :white_check_mark: |
agentmodel | :white_check_mark: | :white_check_mark: |
unet | :white_check_mark: | :red_circle: |
resnet50v1 | :white_check_mark: | :white_check_mark: |
bert_base_cased_fp16 | :white_check_mark: | :white_check_mark: |
bert_large_uncased_fp16 | :red_circle: | :white_check_mark: |
bert_large | :white_check_mark: | :white_check_mark: |
yolov5s | :white_check_mark: | :white_check_mark: |
tinyllama | :white_check_mark: | :white_check_mark: |
vicuna-fastchat | :white_check_mark: | :white_check_mark: |
whisper-tiny-encoder | :white_check_mark: | :red_circle: |
whisper-tiny-decoder | :white_check_mark: | :white_check_mark: |
distilgpt2_fp16 | :white_check_mark: | :white_check_mark: |
:white_check_mark: - within tolerance :red_circle: - not within tolerance :x: - error in execution
Test | Batch | Rate new e315c0 |
Rate old c51bea |
Diff | Compare | |
---|---|---|---|---|---|---|
torchvision-resnet50 | 64 | 3,256.58 | 3,257.81 | -0.04% | :white_check_mark: | |
torchvision-resnet50_fp16 | 64 | 6,979.68 | 6,987.81 | -0.12% | :white_check_mark: | |
torchvision-densenet121 | 32 | 2,435.78 | 2,434.57 | 0.05% | :white_check_mark: | |
torchvision-densenet121_fp16 | 32 | 4,093.65 | 4,065.61 | 0.69% | :white_check_mark: | |
torchvision-inceptionv3 | 32 | 1,627.18 | 1,637.17 | -0.61% | :white_check_mark: | |
torchvision-inceptionv3_fp16 | 32 | 2,744.00 | 2,759.26 | -0.55% | :white_check_mark: | |
cadene-inceptionv4 | 16 | 764.64 | 776.31 | -1.50% | :white_check_mark: | |
cadene-resnext64x4 | 16 | 811.31 | 811.75 | -0.05% | :white_check_mark: | |
slim-mobilenet | 64 | 7,463.49 | 7,533.16 | -0.92% | :white_check_mark: | |
slim-nasnetalarge | 64 | 208.34 | 211.39 | -1.44% | :white_check_mark: | |
slim-resnet50v2 | 64 | 3,440.31 | 3,504.83 | -1.84% | :white_check_mark: | |
bert-mrpc-onnx | 8 | 1,149.50 | 1,146.47 | 0.26% | :white_check_mark: | |
bert-mrpc-tf | 1 | 463.19 | 473.89 | -2.26% | :white_check_mark: | |
pytorch-examples-wlang-gru | 1 | 421.43 | 425.31 | -0.91% | :white_check_mark: | |
pytorch-examples-wlang-lstm | 1 | 395.22 | 408.68 | -3.29% | :red_circle: | |
torchvision-resnet50_1 | 1 | 804.04 | 771.75 | 4.18% | :high_brightness: | |
cadene-dpn92_1 | 1 | 398.53 | 399.01 | -0.12% | :white_check_mark: | |
cadene-resnext101_1 | 1 | 382.92 | 383.85 | -0.24% | :white_check_mark: | |
onnx-taau-downsample | 1 | 345.37 | 343.09 | 0.66% | :white_check_mark: | |
dlrm-criteoterabyte | 1 | 33.31 | 33.31 | 0.01% | :white_check_mark: | |
dlrm-criteoterabyte_fp16 | 1 | 52.74 | 52.71 | 0.06% | :white_check_mark: | |
agentmodel | 1 | 8,382.37 | 8,235.67 | 1.78% | :white_check_mark: | |
unet_fp16 | 2 | 58.76 | 58.90 | -0.24% | :white_check_mark: | |
resnet50v1_fp16 | 1 | 946.66 | 940.89 | 0.61% | :white_check_mark: | |
resnet50v1_int8 | 1 | 1,016.56 | 1,025.93 | -0.91% | :white_check_mark: | |
bert_base_cased_fp16 | 64 | 1,171.39 | 1,170.88 | 0.04% | :white_check_mark: | |
bert_large_uncased_fp16 | 32 | 363.64 | 363.69 | -0.01% | :white_check_mark: | |
bert_large_fp16 | 1 | 198.82 | 200.14 | -0.66% | :white_check_mark: | |
distilgpt2_fp16 | 16 | 2,199.34 | 2,200.77 | -0.07% | :white_check_mark: | |
yolov5s | 1 | 542.01 | 535.15 | 1.28% | :white_check_mark: | |
tinyllama | 1 | 43.74 | 43.41 | 0.76% | :white_check_mark: | |
vicuna-fastchat | 1 | 175.88 | 178.09 | -1.24% | :white_check_mark: | |
whisper-tiny-encoder | 1 | 418.72 | 418.18 | 0.13% | :white_check_mark: | |
whisper-tiny-decoder | 1 | 427.27 | 427.58 | -0.07% | :white_check_mark: |
This build is not recommended to merge :red_circle:
:red_circle:bert_large_uncased_fp16: FAILED: MIGraphX is not within tolerance - check verbose output
All modified and coverable lines are covered by tests :white_check_mark:
Project coverage is 92.17%. Comparing base (
2f97579
) to head (e315c0d
). Report is 6 commits behind head on develop.
:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.
Update rocMLIR version