migraphx-benchmark / AMDMIGraphX

AMD's graph optimization engine.
https://rocmsoftwareplatform.github.io/AMDMIGraphX/doc/html/
MIT License
0 stars 1 forks source link

testing PR action #2

Closed IgorMirosavljevicHTEC closed 2 years ago

IgorMirosavljevicHTEC commented 2 years ago

Testing PR call

migraphx-bot commented 2 years ago
Test Rate new
2783c6
Rate old
ca8a54
Diff
torchvision-resnet50 2,200.59 2,144.48 :white_check_mark: 2.62%
torchvision-resnet50_fp16 4,735.83 4,733.27 :white_check_mark: 0.05%
torchvision-alexnet 4,970.02 4,963.05 :white_check_mark: 0.14%
torchvision-alexnet_fp16 26,113.92 26,764.69 :white_check_mark: -2.43%
torchvision-densenet121 1,628.93 1,348.36 :white_check_mark: 20.81%
torchvision-densenet121_fp16 2,524.61 2,400.74 :white_check_mark: 5.16%
torchvision-inceptionv3 1,094.82 865.49 :white_check_mark: 26.50%
torchvision-inceptionv3_fp16 1,979.01 1,985.16 :white_check_mark: -0.31%
torchvision-vgg16 893.83 893.39 :white_check_mark: 0.05%
torchvision-vgg16_fp16 1,723.63 1,772.62 :white_check_mark: -2.76%
cadene-inceptionv4 525.92 503.66 :white_check_mark: 4.42%
cadene-resnext64x4 573.58 540.14 :white_check_mark: 6.19%
slim-mobilenet 6,383.85 6,381.18 :white_check_mark: 0.04%
nan nan nan :x: nan%
nan nan nan :x: nan%
nan nan nan :x: nan%
nan nan nan :x: nan%
nan nan nan :x: nan%
nan nan nan :x: nan%
nan nan nan :x: nan%
nan nan nan :x: nan%
nan nan nan :x: nan%
nan nan nan :x: nan%
nan nan nan :x: nan%
nan nan nan :x: nan%
nan nan nan :x: nan%
nan nan nan :x: nan%
nan nan nan :x: nan%

This build is not recommended to merge :red_circle:

migraphx-bot commented 2 years ago
Test Rate new
ca8a54
Rate old
2783c6
Diff
torchvision-resnet50 2,143.21 2,200.59 :white_check_mark: -2.61%
torchvision-resnet50_fp16 4,740.85 4,735.83 :white_check_mark: 0.11%
torchvision-alexnet 4,963.90 4,970.02 :white_check_mark: -0.12%
torchvision-alexnet_fp16 26,719.21 26,113.92 :high_brightness: 2.32%
torchvision-densenet121 1,348.25 1,628.93 :white_check_mark: -17.23%
torchvision-densenet121_fp16 572.76 2,524.61 :white_check_mark: -77.31%
torchvision-inceptionv3 1,300.33 1,094.82 :white_check_mark: 18.77%
torchvision-inceptionv3_fp16 1,981.03 1,979.01 :white_check_mark: 0.10%
torchvision-vgg16 893.21 893.83 :white_check_mark: -0.07%
torchvision-vgg16_fp16 1,772.00 1,723.63 :white_check_mark: 2.81%
cadene-inceptionv4 503.08 525.92 :white_check_mark: -4.34%
cadene-resnext64x4 539.96 573.58 :white_check_mark: -5.86%
slim-mobilenet 6,390.99 6,383.85 :white_check_mark: 0.11%
slim-nasnetalarge 188.07 nan :x: nan%
slim-resnet50v2 2,394.96 nan :x: nan%
bert-mrpc-onnx 640.40 nan :x: nan%
bert-mrpc-tf 289.63 nan :x: nan%
pytorch-examples-wlang-gru 227.46 nan :x: nan%
pytorch-examples-wlang-lstm 304.08 nan :x: nan%
torchvision-resnet50_1 95.56 nan :x: nan%
torchvision-inceptionv3_1 155.99 nan :x: nan%
torchvision-vgg16_1 459.58 nan :x: nan%
cadene-dpn92_1 122.60 nan :x: nan%
cadene-resnext101_1 37.70 nan :x: nan%
slim-vgg16_1 63.73 nan :x: nan%
slim-mobilenet_1 1,944.03 nan :x: nan%
slim-inceptionv4_1 68.85 nan :x: nan%
onnx-taau-downsample 254.48 nan :x: nan%

This build is not recommended to merge :red_circle:

migraphx-bot commented 2 years ago
Test Rate new
6e6cb9
Rate old
6e6cb9
Diff
torchvision-resnet50 2,224.61 2,224.70 :white_check_mark: -0.00%
torchvision-resnet50_fp16 4,747.42 4,748.51 :white_check_mark: -0.02%
torchvision-alexnet 4,978.14 4,976.87 :white_check_mark: 0.03%
torchvision-alexnet_fp16 26,370.66 26,241.45 :white_check_mark: 0.49%
torchvision-densenet121 1,635.73 1,637.36 :white_check_mark: -0.10%
torchvision-densenet121_fp16 2,530.26 2,527.01 :white_check_mark: 0.13%
torchvision-inceptionv3 1,097.04 1,094.91 :white_check_mark: 0.19%
torchvision-inceptionv3_fp16 1,989.04 1,979.87 :white_check_mark: 0.46%
torchvision-vgg16 896.06 896.17 :white_check_mark: -0.01%
torchvision-vgg16_fp16 1,727.20 1,726.87 :white_check_mark: 0.02%
cadene-inceptionv4 528.73 528.26 :white_check_mark: 0.09%
cadene-resnext64x4 577.71 577.98 :white_check_mark: -0.05%
slim-mobilenet 6,396.87 6,400.00 :white_check_mark: -0.05%
slim-nasnetalarge 203.26 203.45 :white_check_mark: -0.09%
slim-resnet50v2 2,429.90 2,432.77 :white_check_mark: -0.12%
bert-mrpc-onnx 639.31 639.62 :white_check_mark: -0.05%
bert-mrpc-tf 295.07 295.87 :white_check_mark: -0.27%
pytorch-examples-wlang-gru 228.55 229.64 :white_check_mark: -0.47%
pytorch-examples-wlang-lstm 306.85 306.36 :white_check_mark: 0.16%
torchvision-resnet50_1 512.03 516.19 :white_check_mark: -0.81%
torchvision-inceptionv3_1 302.73 303.27 :white_check_mark: -0.18%
torchvision-vgg16_1 463.05 463.57 :white_check_mark: -0.11%
cadene-dpn92_1 304.35 304.94 :white_check_mark: -0.19%
cadene-resnext101_1 237.41 238.44 :white_check_mark: -0.43%
slim-vgg16_1 64.03 64.01 :white_check_mark: 0.04%
slim-mobilenet_1 1,980.67 1,973.29 :white_check_mark: 0.37%
slim-inceptionv4_1 195.92 194.97 :white_check_mark: 0.49%
onnx-taau-downsample 259.02 258.87 :white_check_mark: 0.06%

This build is OK for merge :white_check_mark: