migraphx-benchmark / AMDMIGraphX

AMD's graph optimization engine.
https://rocmsoftwareplatform.github.io/AMDMIGraphX/doc/html/
MIT License
0 stars 1 forks source link

Testing PR Performance tests #61

Closed pavlejacovicHTEC closed 1 year ago

pavlejacovicHTEC commented 1 year ago

Testing new logic for model removal

migraphx-bot commented 1 year ago
Test Batch Rate new
e0dee0
Rate old
09aaa6
Diff Compare
torchvision-resnet50 64 2,263.84 2,263.05 0.03% :white_check_mark:
torchvision-resnet50_fp16 64 5,273.18 5,277.00 -0.07% :white_check_mark:
torchvision-densenet121 32 1,783.98 1,780.65 0.19% :white_check_mark:
torchvision-densenet121_fp16 32 3,246.83 3,247.59 -0.02% :white_check_mark:
torchvision-inceptionv3 32 1,313.34 1,313.69 -0.03% :white_check_mark:
torchvision-inceptionv3_fp16 32 2,329.22 2,319.09 0.44% :white_check_mark:
cadene-inceptionv4 16 666.95 672.36 -0.80% :white_check_mark:
cadene-resnext64x4 16 592.40 592.50 -0.02% :white_check_mark:
slim-mobilenet 64 7,152.16 7,157.20 -0.07% :white_check_mark:
slim-nasnetalarge 64 228.77 229.68 -0.40% :white_check_mark:
slim-resnet50v2 64 2,348.36 2,348.31 0.00% :white_check_mark:
bert-mrpc-onnx 8 852.03 851.63 0.05% :white_check_mark:
bert-mrpc-tf 1 304.93 306.20 -0.41% :white_check_mark:
pytorch-examples-wlang-gru 1 317.00 313.18 1.22% :white_check_mark:
pytorch-examples-wlang-lstm 1 316.13 310.18 1.92% :white_check_mark:
torchvision-resnet50_1 1 531.15 526.19 0.94% :white_check_mark:
torchvision-inceptionv3_1 1 299.54 298.83 0.24% :white_check_mark:
cadene-dpn92_1 1 326.05 329.27 -0.98% :white_check_mark:
cadene-resnext101_1 1 230.35 229.85 0.22% :white_check_mark:
slim-vgg16_1 1 158.34 158.17 0.11% :white_check_mark:
slim-mobilenet_1 1 1,547.64 1,484.70 4.24% :high_brightness:
slim-inceptionv4_1 1 190.94 189.76 0.62% :white_check_mark:
onnx-taau-downsample 1 323.49 323.24 0.08% :white_check_mark:
dlrm-criteoterabyte 1 nan 20.84 nan% :x:
dlrm-criteoterabyte_fp16 1 nan 39.46 nan% :x:
agentmodel 1 5,037.30 5,040.58 -0.06% :white_check_mark:

This build is not recommended to merge :red_circle:

migraphx-bot commented 1 year ago


    :white_check_mark:bert-mrpc-onnx: PASSED: MIGraphX meets tolerance
    :white_check_mark:bert-mrpc-tf: PASSED: MIGraphX meets tolerance
    :white_check_mark:pytorch-examples-wlang-gru: PASSED: MIGraphX meets tolerance
    :white_check_mark:pytorch-examples-wlang-lstm: PASSED: MIGraphX meets tolerance
    :white_check_mark:torchvision-resnet50_1: PASSED: MIGraphX meets tolerance
    :white_check_mark:torchvision-inceptionv3_1: PASSED: MIGraphX meets tolerance
    :white_check_mark:cadene-dpn92_1: PASSED: MIGraphX meets tolerance
    :white_check_mark:cadene-resnext101_1: PASSED: MIGraphX meets tolerance
    :white_check_mark:slim-vgg16_1: PASSED: MIGraphX meets tolerance
    :white_check_mark:slim-mobilenet_1: PASSED: MIGraphX meets tolerance
    :white_check_mark:slim-inceptionv4_1: PASSED: MIGraphX meets tolerance
    :white_check_mark:dlrm-criteoterabyte: PASSED: MIGraphX meets tolerance
    :white_check_mark:agentmodel: PASSED: MIGraphX meets tolerance