Closed sohaibnd closed 1 month ago
Test | Batch | Rate new b65fbd |
Rate old ddc4c0 |
Diff | Compare | |
---|---|---|---|---|---|---|
torchvision-resnet50 | 64 | 3,260.45 | 3,260.53 | -0.00% | :white_check_mark: | |
torchvision-resnet50_fp16 | 64 | 6,996.07 | 6,988.30 | 0.11% | :white_check_mark: | |
torchvision-densenet121 | 32 | 2,434.20 | 2,435.76 | -0.06% | :white_check_mark: | |
torchvision-densenet121_fp16 | 32 | 4,093.43 | 4,073.89 | 0.48% | :white_check_mark: | |
torchvision-inceptionv3 | 32 | 1,638.36 | 1,638.33 | 0.00% | :white_check_mark: | |
torchvision-inceptionv3_fp16 | 32 | 2,766.20 | 2,763.22 | 0.11% | :white_check_mark: | |
cadene-inceptionv4 | 16 | 775.83 | 776.49 | -0.09% | :white_check_mark: | |
cadene-resnext64x4 | 16 | 812.55 | 811.34 | 0.15% | :white_check_mark: | |
slim-mobilenet | 64 | 7,537.64 | 7,533.02 | 0.06% | :white_check_mark: | |
slim-nasnetalarge | 64 | 211.54 | 211.47 | 0.04% | :white_check_mark: | |
slim-resnet50v2 | 64 | 3,505.64 | 3,506.35 | -0.02% | :white_check_mark: | |
bert-mrpc-onnx | 8 | 1,152.24 | 1,151.01 | 0.11% | :white_check_mark: | |
bert-mrpc-tf | 1 | 472.57 | 498.30 | -5.16% | :red_circle: | |
pytorch-examples-wlang-gru | 1 | 425.17 | 422.79 | 0.56% | :white_check_mark: | |
pytorch-examples-wlang-lstm | 1 | 456.49 | 390.98 | 16.75% | :high_brightness: | |
torchvision-resnet50_1 | 1 | 790.73 | 767.34 | 3.05% | :high_brightness: | |
cadene-dpn92_1 | 1 | 436.28 | 399.69 | 9.15% | :high_brightness: | |
cadene-resnext101_1 | 1 | 384.95 | 383.25 | 0.44% | :white_check_mark: | |
onnx-taau-downsample | 1 | 343.24 | 342.66 | 0.17% | :white_check_mark: | |
dlrm-criteoterabyte | 1 | 33.36 | 33.32 | 0.10% | :white_check_mark: | |
dlrm-criteoterabyte_fp16 | 1 | 52.73 | 52.71 | 0.04% | :white_check_mark: | |
agentmodel | 1 | 8,487.88 | 8,354.43 | 1.60% | :white_check_mark: | |
unet_fp16 | 2 | 58.85 | 58.81 | 0.06% | :white_check_mark: | |
resnet50v1_fp16 | 1 | 930.94 | 935.55 | -0.49% | :white_check_mark: | |
resnet50v1_int8 | 1 | 1,017.03 | 1,001.70 | 1.53% | :white_check_mark: | |
bert_base_cased_fp16 | 64 | 1,171.64 | 1,170.66 | 0.08% | :white_check_mark: | |
bert_large_uncased_fp16 | 32 | 363.82 | 363.70 | 0.03% | :white_check_mark: | |
bert_large_fp16 | 1 | 200.45 | 198.87 | 0.79% | :white_check_mark: | |
distilgpt2_fp16 | 16 | 2,204.28 | 2,203.10 | 0.05% | :white_check_mark: | |
yolov5s | 1 | 534.28 | 531.68 | 0.49% | :white_check_mark: | |
tinyllama | 1 | 43.43 | 43.43 | 0.01% | :white_check_mark: | |
vicuna-fastchat | 1 | 180.21 | 179.99 | 0.13% | :white_check_mark: | |
whisper-tiny-encoder | 1 | 418.33 | 417.45 | 0.21% | :white_check_mark: | |
whisper-tiny-decoder | 1 | 425.89 | 423.52 | 0.56% | :white_check_mark: |
This build is not recommended to merge :red_circle:
:red_circle:bert_large_uncased_fp16: FAILED: MIGraphX is not within tolerance - check verbose output
op_name is empty in the op_desc of many operators in the onnx and tf parsers (issue)