search

migraphx-benchmark / AMDMIGraphX

AMD's graph optimization engine.
https://rocmsoftwareplatform.github.io/AMDMIGraphX/doc/html/
MIT License
0 stars 1 forks source link

Dyn batch pass #46

Closed pavlejacovicHTEC closed 1 year ago

migraphx-bot commented 1 year ago
Test Batch Rate new
cfd128		 Rate old
f33ffb		 Diff Compare
torchvision-resnet50 64 2,261.89 2,262.69 -0.04% :white_check_mark:
torchvision-resnet50_fp16 64 5,258.27 5,262.90 -0.09% :white_check_mark:
torchvision-alexnet 64 9,450.47 9,450.19 0.00% :white_check_mark:
torchvision-alexnet_fp16 64 30,872.09 30,860.48 0.04% :white_check_mark:
torchvision-densenet121 32 1,780.80 1,782.00 -0.07% :white_check_mark:
torchvision-densenet121_fp16 32 3,251.85 3,250.35 0.05% :white_check_mark:
torchvision-inceptionv3 32 1,318.39 1,321.54 -0.24% :white_check_mark:
torchvision-inceptionv3_fp16 32 2,317.46 2,314.60 0.12% :white_check_mark:
torchvision-vgg16 16 893.34 892.76 0.06% :white_check_mark:
torchvision-vgg16_fp16 16 2,126.60 2,143.38 -0.78% :white_check_mark:
cadene-inceptionv4 16 662.49 665.45 -0.44% :white_check_mark:
cadene-resnext64x4 16 592.41 593.82 -0.24% :white_check_mark:
slim-mobilenet 64 7,157.20 7,147.74 0.13% :white_check_mark:
slim-nasnetalarge 64 228.60 228.71 -0.05% :white_check_mark:
slim-resnet50v2 64 2,348.71 2,346.97 0.07% :white_check_mark:
bert-mrpc-onnx 8 nan nan nan% :x:
bert-mrpc-tf 1 305.27 306.26 -0.32% :white_check_mark:
pytorch-examples-wlang-gru 1 309.98 312.35 -0.76% :white_check_mark:
pytorch-examples-wlang-lstm 1 310.96 317.66 -2.11% :white_check_mark:
torchvision-resnet50_1 1 532.84 531.04 0.34% :white_check_mark:
torchvision-inceptionv3_1 1 299.38 297.20 0.74% :white_check_mark:
torchvision-vgg16_1 1 459.58 461.91 -0.50% :white_check_mark:
cadene-dpn92_1 1 325.37 328.65 -1.00% :white_check_mark:
cadene-resnext101_1 1 230.64 230.91 -0.12% :white_check_mark:
slim-vgg16_1 1 158.30 158.28 0.01% :white_check_mark:
slim-mobilenet_1 1 1,515.74 1,501.40 0.96% :white_check_mark:
slim-inceptionv4_1 1 189.59 189.02 0.30% 0
onnx-taau-downsample 1 323.79 323.07 0.22% 0
dlrm-criteoterabyte 1 19.59 19.60 -0.05% 0
dlrm-criteoterabyte_fp16 1 35.83 35.75 0.21% 0
agentmodel 1 5,046.40 5,021.11 0.50% 0

This build is not recommended to merge :red_circle:

migraphx-bot commented 1 year ago


    :white_check_mark:bert-mrpc-onnx: PASSED: MIGraphX meets tolerance
    :white_check_mark:bert-mrpc-tf: PASSED: MIGraphX meets tolerance
    :white_check_mark:pytorch-examples-wlang-gru: PASSED: MIGraphX meets tolerance
    :white_check_mark:pytorch-examples-wlang-lstm: PASSED: MIGraphX meets tolerance
    :white_check_mark:torchvision-resnet50_1: PASSED: MIGraphX meets tolerance
    :white_check_mark:torchvision-inceptionv3_1: PASSED: MIGraphX meets tolerance
    :white_check_mark:cadene-dpn92_1: PASSED: MIGraphX meets tolerance
    :white_check_mark:cadene-resnext101_1: PASSED: MIGraphX meets tolerance
    :white_check_mark:slim-vgg16_1: PASSED: MIGraphX meets tolerance
    :white_check_mark:slim-mobilenet_1: PASSED: MIGraphX meets tolerance
    :white_check_mark:slim-inceptionv4_1: PASSED: MIGraphX meets tolerance
    :white_check_mark:dlrm-criteoterabyte: PASSED: MIGraphX meets tolerance
    :white_check_mark:agenmodel: PASSED: MIGraphX meets tolerance