migraphx-benchmark / AMDMIGraphX

AMD's graph optimization engine.
https://rocmsoftwareplatform.github.io/AMDMIGraphX/doc/html/
MIT License
0 stars 1 forks source link

Reports #1

Open IgorMirosavljevicHTEC opened 2 years ago

vidojegavrilovichtec commented 2 years ago
Test Rate new Rate old Diff
torchvision-resnet50 1,932.54 1,931.91 :white_check_mark: 0.03%
torchvision-resnet50_fp16 4,680.38 4,679.97 :white_check_mark: 0.01%
torchvision-alexnet 4,698.63 4,702.04 :red_circle: -0.07%
torchvision-alexnet_fp16 24,658.35 24,735.83 :red_circle: -0.31%
torchvision-densenet121 1,192.42 1,192.29 :white_check_mark: 0.01%
torchvision-densenet121_fp16 2,373.13 2,376.97 :red_circle: -0.16%
torchvision-inceptionv3 990.57 990.08 :white_check_mark: 0.05%
torchvision-inceptionv3_fp16 1,889.62 1,889.67 :red_circle: -0.00%
torchvision-vgg16 779.94 779.95 :red_circle: -0.00%
torchvision-vgg16_fp16 1,789.51 1,789.55 :red_circle: -0.00%
cadene-inceptionv4 528.86 529.04 :red_circle: -0.03%
cadene-resnext64x4 489.44 489.50 :red_circle: -0.01%
slim-mobilenet 6,240.25 6,238.73 :white_check_mark: 0.02%
slim-nasnetalarge 172.59 172.61 :red_circle: -0.01%
slim-resnet50v2 2,194.46 2,194.76 :red_circle: -0.01%
bert-mrpc-onnx 488.73 488.75 :red_circle: -0.00%
bert-mrpc-tf 230.42 230.07 :white_check_mark: 0.15%
pytorchexamples-wlang-gru 187.71 187.88 :red_circle: -0.09%
pytorchexamples-wlang-lstm 305.48 305.54 :red_circle: -0.02%
torchvision-resnet50_1 91.19 90.93 :white_check_mark: 0.28%
torchvision-inceptionv3_1 128.03 127.95 :white_check_mark: 0.06%
torchvision-vgg16_1 387.31 387.23 :white_check_mark: 0.02%
cadene-dpn92_1 120.90 120.76 :white_check_mark: 0.11%
cadene-resnext101_1 37.36 37.26 :white_check_mark: 0.27%
slim-vgg16_1 62.37 62.38 :red_circle: -0.01%
slim-mobilenet_1 1,703.06 1,707.88 :red_circle: -0.28%
slim-inceptionv4_1 59.08 58.92 :white_check_mark: 0.27%
onnx-taau-downsample 244.81 244.89 :red_circle: -0.03%
vidojegavrilovichtec commented 2 years ago
Test Rate new Rate old Diff
torchvision-resnet50 1,933.00 1,312.21 :white_check_mark: 47.31%
torchvision-resnet50_fp16 4,679.32 4,671.46 :white_check_mark: 0.17%
torchvision-alexnet 3,202.02 4,689.50 :red_circle: -31.72%
torchvision-alexnet_fp16 24,688.69 24,664.14 :white_check_mark: 0.10%
torchvision-densenet121 1,172.91 1,172.35 :white_check_mark: 0.05%
torchvision-densenet121_fp16 2,263.63 2,291.39 :red_circle: -1.21%
torchvision-inceptionv3 989.21 988.15 :white_check_mark: 0.11%
torchvision-inceptionv3_fp16 1,878.75 1,881.58 :red_circle: -0.15%
torchvision-vgg16 778.44 778.43 :white_check_mark: 0.00%
torchvision-vgg16_fp16 1,782.21 1,778.12 :white_check_mark: 0.23%
cadene-inceptionv4 524.95 357.23 :white_check_mark: 46.95%
cadene-resnext64x4 490.46 488.30 :white_check_mark: 0.44%
slim-mobilenet 4,292.51 3,624.97 :white_check_mark: 18.41%
slim-nasnetalarge 171.45 170.28 :white_check_mark: 0.69%
slim-resnet50v2 2,195.98 2,007.19 :white_check_mark: 9.41%
bert-mrpc-onnx 217.52 484.02 :red_circle: -55.06%
bert-mrpc-tf 131.61 222.25 :red_circle: -40.78%
pytorchexamples-wlang-gru nan 186.37 nan
pytorchexamples-wlang-lstm 301.98 169.16 :white_check_mark: 78.52%
torchvision-resnet50_1 90.93 90.89 :white_check_mark: 0.04%
torchvision-inceptionv3_1 127.65 127.41 :white_check_mark: 0.19%
torchvision-vgg16_1 349.10 385.67 :red_circle: -9.48%
cadene-dpn92_1 118.35 nan nan
cadene-resnext101_1 37.24 nan nan
slim-vgg16_1 62.32 nan nan
slim-mobilenet_1 1,714.75 nan nan
slim-inceptionv4_1 58.91 nan nan
onnx-taau-downsample 245.08 nan nan
vidojegavrilovichtec commented 2 years ago
Test Rate new Rate old Diff 1339ba 1339ba
torchvision-resnet50 1,932.95 1,931.65 :white_check_mark: 0.07%
torchvision-resnet50_fp16 4,686.82 4,682.37 :white_check_mark: 0.10%
torchvision-alexnet 4,697.63 4,697.08 :white_check_mark: 0.01%
torchvision-alexnet_fp16 24,733.25 24,715.20 :white_check_mark: 0.07%
torchvision-densenet121 1,195.55 1,173.11 :white_check_mark: 1.91%
torchvision-densenet121_fp16 2,359.46 2,359.66 :white_check_mark: -0.01%
torchvision-inceptionv3 991.84 991.23 :white_check_mark: 0.06%
torchvision-inceptionv3_fp16 1,890.25 1,889.95 :white_check_mark: 0.02%
torchvision-vgg16 779.51 779.54 :white_check_mark: -0.00%
torchvision-vgg16_fp16 1,785.46 1,784.15 :white_check_mark: 0.07%
cadene-inceptionv4 528.12 528.24 :white_check_mark: -0.02%
cadene-resnext64x4 491.29 491.25 :white_check_mark: 0.01%
slim-mobilenet 6,239.76 6,241.35 :white_check_mark: -0.03%
slim-nasnetalarge 172.56 172.55 :white_check_mark: 0.01%
slim-resnet50v2 2,199.30 2,198.65 :white_check_mark: 0.03%
bert-mrpc-onnx 583.09 583.01 :white_check_mark: 0.01%
bert-mrpc-tf 258.12 257.82 :white_check_mark: 0.12%
pytorchexamples-wlang-gru nan nan :x: nan%
pytorchexamples-wlang-lstm 302.54 302.73 :white_check_mark: -0.06%
torchvision-resnet50_1 91.13 91.07 :white_check_mark: 0.07%
torchvision-inceptionv3_1 128.34 128.20 :white_check_mark: 0.11%
torchvision-vgg16_1 387.36 387.29 :white_check_mark: 0.02%
cadene-dpn92_1 121.09 120.90 :white_check_mark: 0.15%
cadene-resnext101_1 37.28 37.25 :white_check_mark: 0.08%
slim-vgg16_1 62.37 62.37 :white_check_mark: 0.00%
slim-mobilenet_1 1,712.20 1,718.64 :white_check_mark: -0.37%
slim-inceptionv4_1 59.07 59.14 :white_check_mark: -0.11%
onnx-taau-downsample 245.10 245.14 :white_check_mark: -0.02%

This build is not recommended to merge :red_circle:

vidojegavrilovichtec commented 2 years ago
Test Rate new 7271dd Rate old 7271dd Diff
torchvision-resnet50 1,930.19 1,933.40 :white_check_mark: -0.17%
torchvision-resnet50_fp16 4,677.54 4,687.00 :white_check_mark: -0.20%
torchvision-alexnet 4,698.66 4,701.32 :white_check_mark: -0.06%
torchvision-alexnet_fp16 24,711.47 24,657.02 :high_brightness: 0.22%
torchvision-densenet121 595.41 501.98 :high_brightness: 18.61%
torchvision-densenet121_fp16 2,229.47 2,280.16 :white_check_mark: -2.22%
torchvision-inceptionv3 978.28 715.60 :high_brightness: 36.71%
torchvision-inceptionv3_fp16 1,881.28 1,880.82 :white_check_mark: 0.02%
torchvision-vgg16 777.60 777.17 :white_check_mark: 0.06%
torchvision-vgg16_fp16 1,778.49 1,782.06 :white_check_mark: -0.20%
cadene-inceptionv4 247.08 525.14 :red_circle: -52.95%
cadene-resnext64x4 233.48 490.58 :red_circle: -52.41%
slim-mobilenet 6,165.35 6,219.15 :white_check_mark: -0.87%
slim-nasnetalarge 166.67 172.00 :white_check_mark: -3.10%
slim-resnet50v2 2,195.24 1,395.58 :high_brightness: 57.30%
bert-mrpc-onnx 578.51 578.33 :white_check_mark: 0.03%
bert-mrpc-tf 254.72 254.39 :white_check_mark: 0.13%
pytorchexamples-wlang-gru nan nan :x: nan%
pytorchexamples-wlang-lstm 300.75 96.28 :high_brightness: 212.38%
torchvision-resnet50_1 90.97 90.71 :white_check_mark: 0.28%
torchvision-inceptionv3_1 127.27 74.88 :high_brightness: 69.95%
torchvision-vgg16_1 386.05 375.70 :high_brightness: 2.75%
cadene-dpn92_1 119.55 119.74 :white_check_mark: -0.16%
nan nan nan :x: nan%
nan nan nan :x: nan%
nan nan nan :x: nan%
nan nan nan :x: nan%
nan nan nan :x: nan%

This build is not recommended to merge :red_circle:

vidojegavrilovichtec commented 2 years ago
Test Rate new
7271dd
Rate old
7271dd
Diff
torchvision-resnet50 1,929.58 1,930.19 :white_check_mark: -0.03%
torchvision-resnet50_fp16 4,677.78 4,677.54 :white_check_mark: 0.01%
torchvision-alexnet 4,696.39 4,698.66 :white_check_mark: -0.05%
torchvision-alexnet_fp16 24,725.22 24,711.47 :white_check_mark: 0.06%
torchvision-densenet121 1,196.81 595.41 :high_brightness: 101.00%
torchvision-densenet121_fp16 2,361.07 2,229.47 :white_check_mark: 5.90%
torchvision-inceptionv3 991.53 978.28 :high_brightness: 1.35%
torchvision-inceptionv3_fp16 1,890.09 1,881.28 :white_check_mark: 0.47%
torchvision-vgg16 779.50 777.60 :white_check_mark: 0.24%
torchvision-vgg16_fp16 1,785.38 1,778.49 :white_check_mark: 0.39%
cadene-inceptionv4 528.46 247.08 :high_brightness: 113.88%
cadene-resnext64x4 491.22 233.48 :high_brightness: 110.39%
slim-mobilenet 6,245.61 6,165.35 :white_check_mark: 1.30%
slim-nasnetalarge 172.60 166.67 :white_check_mark: 3.56%
slim-resnet50v2 2,199.59 2,195.24 :white_check_mark: 0.20%
bert-mrpc-onnx 583.08 578.51 :white_check_mark: 0.79%
bert-mrpc-tf 258.04 254.72 :white_check_mark: 1.30%
pytorchexamples-wlang-gru nan nan :x: nan%
pytorchexamples-wlang-lstm 301.99 300.75 :white_check_mark: 0.41%
torchvision-resnet50_1 91.05 90.97 :white_check_mark: 0.08%
torchvision-inceptionv3_1 128.21 127.27 :white_check_mark: 0.75%
torchvision-vgg16_1 387.44 386.05 :white_check_mark: 0.36%
cadene-dpn92_1 121.08 119.55 :white_check_mark: 1.28%
cadene-resnext101_1 37.31 37.18 :white_check_mark: 0.35%
slim-vgg16_1 62.37 52.57 :white_check_mark: 18.65%
slim-mobilenet_1 1,714.95 1,715.20 :white_check_mark: -0.01%
slim-inceptionv4_1 59.04 58.89 :white_check_mark: 0.26%
onnx-taau-downsample 245.12 244.80 :white_check_mark: 0.13%

This build is not recommended to merge :red_circle:

vidojegavrilovichtec commented 2 years ago
Test Rate new
7271dd
Rate old
7271dd
Diff
torchvision-resnet50 1,932.90 1,929.58 :white_check_mark: 0.17%
torchvision-resnet50_fp16 4,686.52 4,677.78 :white_check_mark: 0.19%
torchvision-alexnet 4,701.63 4,696.39 :white_check_mark: 0.11%
torchvision-alexnet_fp16 24,661.77 24,725.22 :red_circle: -0.26%
torchvision-densenet121 1,194.79 1,196.81 :white_check_mark: -0.17%
torchvision-densenet121_fp16 2,358.58 2,361.07 :white_check_mark: -0.11%
torchvision-inceptionv3 991.54 991.53 :white_check_mark: 0.00%
torchvision-inceptionv3_fp16 1,889.50 1,890.09 :white_check_mark: -0.03%
torchvision-vgg16 779.72 779.50 :white_check_mark: 0.03%
torchvision-vgg16_fp16 1,784.83 1,785.38 :white_check_mark: -0.03%
cadene-inceptionv4 528.29 528.46 :white_check_mark: -0.03%
cadene-resnext64x4 491.18 491.22 :white_check_mark: -0.01%
slim-mobilenet 6,238.06 6,245.61 :white_check_mark: -0.12%
slim-nasnetalarge 172.56 172.60 :white_check_mark: -0.03%
slim-resnet50v2 2,198.81 2,199.59 :white_check_mark: -0.04%
bert-mrpc-onnx 583.23 583.08 :white_check_mark: 0.02%
bert-mrpc-tf 257.93 258.04 :white_check_mark: -0.04%
pytorchexamples-wlang-gru nan nan :x: nan%
pytorchexamples-wlang-lstm 302.26 301.99 :white_check_mark: 0.09%
torchvision-resnet50_1 91.13 91.05 :white_check_mark: 0.09%
torchvision-inceptionv3_1 128.18 128.21 :white_check_mark: -0.02%
torchvision-vgg16_1 387.27 387.44 :white_check_mark: -0.04%
cadene-dpn92_1 121.05 121.08 :white_check_mark: -0.03%
cadene-resnext101_1 37.34 37.31 :white_check_mark: 0.07%
slim-vgg16_1 62.37 62.37 :white_check_mark: -0.01%
slim-mobilenet_1 1,713.75 1,714.95 :white_check_mark: -0.07%
slim-inceptionv4_1 59.02 59.04 :white_check_mark: -0.04%
onnx-taau-downsample 245.05 245.12 :white_check_mark: -0.03%

This build is not recommended to merge :red_circle:

vidojegavrilovichtec commented 2 years ago
Test Rate new
f55d7c
Rate old
7271dd
Diff
torchvision-resnet50 1,932.26 1,932.96 :white_check_mark: -0.04%
torchvision-resnet50_fp16 4,680.69 4,687.82 :white_check_mark: -0.15%
torchvision-alexnet 4,699.70 4,700.70 :white_check_mark: -0.02%
torchvision-alexnet_fp16 24,663.95 24,659.30 :white_check_mark: 0.02%
torchvision-densenet121 1,193.93 1,195.99 :white_check_mark: -0.17%
torchvision-densenet121_fp16 2,373.52 2,360.30 :white_check_mark: 0.56%
torchvision-inceptionv3 990.91 991.88 :white_check_mark: -0.10%
torchvision-inceptionv3_fp16 1,890.73 1,890.07 :white_check_mark: 0.03%
torchvision-vgg16 780.10 779.73 :white_check_mark: 0.05%
torchvision-vgg16_fp16 1,790.26 1,784.93 :white_check_mark: 0.30%
cadene-inceptionv4 528.91 528.28 :white_check_mark: 0.12%
cadene-resnext64x4 489.59 491.18 :white_check_mark: -0.32%
slim-mobilenet 6,235.26 6,236.48 :white_check_mark: -0.02%
slim-nasnetalarge 172.59 172.49 :white_check_mark: 0.06%
slim-resnet50v2 2,194.83 2,200.57 :white_check_mark: -0.26%
bert-mrpc-onnx 488.62 583.23 :red_circle: -16.22%
bert-mrpc-tf 230.00 259.10 :white_check_mark: -11.23%
pytorchexamples-wlang-gru 183.74 nan :x: nan%
pytorchexamples-wlang-lstm 306.44 302.21 :white_check_mark: 1.40%
torchvision-resnet50_1 90.94 91.15 :white_check_mark: -0.24%
torchvision-inceptionv3_1 127.87 128.24 :white_check_mark: -0.29%
torchvision-vgg16_1 387.27 387.51 :white_check_mark: -0.06%
cadene-dpn92_1 120.84 121.19 :white_check_mark: -0.29%
cadene-resnext101_1 37.25 37.33 :white_check_mark: -0.22%
slim-vgg16_1 62.37 62.37 :white_check_mark: 0.00%
slim-mobilenet_1 1,702.06 1,711.70 :white_check_mark: -0.56%
slim-inceptionv4_1 59.03 59.18 :white_check_mark: -0.25%
onnx-taau-downsample 244.27 245.46 :white_check_mark: -0.49%

This build is not recommended to merge :red_circle:

vidojegavrilovichtec commented 2 years ago
Test Rate new
f55d7c
Rate old
f55d7c
Diff
torchvision-resnet50 1,932.11 1,931.88 :white_check_mark: 0.01%
torchvision-resnet50_fp16 4,677.34 4,677.37 :white_check_mark: -0.00%
torchvision-alexnet 4,699.42 4,699.46 :white_check_mark: -0.00%
torchvision-alexnet_fp16 24,660.44 24,664.05 :white_check_mark: -0.01%
torchvision-densenet121 1,193.92 1,194.18 :white_check_mark: -0.02%
torchvision-densenet121_fp16 2,375.31 2,376.36 :white_check_mark: -0.04%
torchvision-inceptionv3 990.46 990.57 :white_check_mark: -0.01%
torchvision-inceptionv3_fp16 1,889.25 1,890.46 :white_check_mark: -0.06%
torchvision-vgg16 779.64 779.64 :white_check_mark: 0.00%
torchvision-vgg16_fp16 1,790.19 1,789.73 :white_check_mark: 0.03%
cadene-inceptionv4 529.17 528.75 :white_check_mark: 0.08%
cadene-resnext64x4 489.44 489.36 :white_check_mark: 0.02%
slim-mobilenet 6,237.39 6,236.54 :white_check_mark: 0.01%
slim-nasnetalarge 172.54 172.56 :white_check_mark: -0.01%
slim-resnet50v2 2,193.53 2,194.40 :white_check_mark: -0.04%
bert-mrpc-onnx 488.67 488.56 :white_check_mark: 0.02%
bert-mrpc-tf 229.80 230.57 :white_check_mark: -0.33%
pytorchexamples-wlang-gru 189.50 187.98 :white_check_mark: 0.81%
pytorchexamples-wlang-lstm 305.39 305.13 :white_check_mark: 0.08%
torchvision-resnet50_1 91.03 90.85 :white_check_mark: 0.20%
torchvision-inceptionv3_1 127.95 127.85 :white_check_mark: 0.08%
torchvision-vgg16_1 387.24 387.34 :white_check_mark: -0.02%
cadene-dpn92_1 120.92 121.24 :white_check_mark: -0.26%
cadene-resnext101_1 37.28 37.30 :white_check_mark: -0.06%
slim-vgg16_1 62.36 62.38 :white_check_mark: -0.03%
slim-mobilenet_1 1,701.75 1,703.49 :white_check_mark: -0.10%
slim-inceptionv4_1 59.02 59.03 :white_check_mark: -0.02%
onnx-taau-downsample 244.28 244.61 :white_check_mark: -0.13%

This build is OK for merge :white_check_mark:

vidojegavrilovichtec commented 2 years ago
Test Rate new
37c475
Rate old
7271dd
Diff
torchvision-resnet50 1,933.14 1,929.14 :white_check_mark: 0.21%
torchvision-resnet50_fp16 4,687.07 4,681.44 :white_check_mark: 0.12%
torchvision-alexnet 4,701.80 4,703.01 :white_check_mark: -0.03%
torchvision-alexnet_fp16 24,659.30 24,724.46 :red_circle: -0.26%
torchvision-densenet121 1,195.10 1,169.03 :high_brightness: 2.23%
torchvision-densenet121_fp16 2,358.75 2,247.96 :white_check_mark: 4.93%
torchvision-inceptionv3 991.45 987.44 :high_brightness: 0.41%
torchvision-inceptionv3_fp16 1,890.21 1,859.89 :white_check_mark: 1.63%
torchvision-vgg16 779.84 779.86 :white_check_mark: -0.00%
torchvision-vgg16_fp16 1,785.16 1,783.70 :white_check_mark: 0.08%
cadene-inceptionv4 527.11 526.81 :white_check_mark: 0.06%
cadene-resnext64x4 490.77 490.43 :white_check_mark: 0.07%
slim-mobilenet 6,232.90 6,230.83 :white_check_mark: 0.03%
slim-nasnetalarge 172.34 172.24 :white_check_mark: 0.06%
slim-resnet50v2 2,200.36 2,202.75 :white_check_mark: -0.11%
bert-mrpc-onnx 581.24 580.18 :white_check_mark: 0.18%
bert-mrpc-tf 252.17 258.91 :white_check_mark: -2.60%
pytorchexamples-wlang-gru nan nan :x: nan%
pytorchexamples-wlang-lstm 301.02 302.03 :white_check_mark: -0.33%
torchvision-resnet50_1 90.81 91.06 :white_check_mark: -0.28%
torchvision-inceptionv3_1 126.82 127.67 :white_check_mark: -0.67%
torchvision-vgg16_1 387.14 387.12 :white_check_mark: 0.01%
cadene-dpn92_1 118.09 118.89 :white_check_mark: -0.68%
cadene-resnext101_1 37.24 37.28 :white_check_mark: -0.11%
slim-vgg16_1 62.36 62.36 :white_check_mark: -0.01%
slim-mobilenet_1 1,711.93 1,710.38 :white_check_mark: 0.09%
slim-inceptionv4_1 58.82 58.56 :white_check_mark: 0.44%
onnx-taau-downsample 244.37 245.35 :white_check_mark: -0.40%

This build is not recommended to merge :red_circle:

vidojegavrilovichtec commented 2 years ago
Test Rate new
aa7ff9
Rate old
aa7ff9
Diff
torchvision-resnet50 1,933.07 1,933.11 :white_check_mark: -0.00%
torchvision-resnet50_fp16 4,689.88 4,687.48 :white_check_mark: 0.05%
torchvision-alexnet 4,701.01 4,703.22 :white_check_mark: -0.05%
torchvision-alexnet_fp16 24,656.16 24,671.46 :white_check_mark: -0.06%
torchvision-densenet121 1,196.06 1,196.29 :white_check_mark: -0.02%
torchvision-densenet121_fp16 2,362.69 2,358.26 :white_check_mark: 0.19%
torchvision-inceptionv3 990.97 990.42 :white_check_mark: 0.06%
torchvision-inceptionv3_fp16 1,890.04 1,891.42 :white_check_mark: -0.07%
torchvision-vgg16 780.12 779.86 :white_check_mark: 0.03%
torchvision-vgg16_fp16 1,785.55 1,785.28 :white_check_mark: 0.01%
cadene-inceptionv4 528.94 527.71 :white_check_mark: 0.23%
cadene-resnext64x4 491.19 491.24 :white_check_mark: -0.01%
slim-mobilenet 6,237.15 6,241.10 :white_check_mark: -0.06%
slim-nasnetalarge 172.82 172.65 :white_check_mark: 0.10%
slim-resnet50v2 2,202.77 2,201.86 :white_check_mark: 0.04%
bert-mrpc-onnx 584.59 583.69 :white_check_mark: 0.15%
bert-mrpc-tf 256.75 257.54 :white_check_mark: -0.31%
pytorch-examples-wlang-gru 213.88 nan :x: nan%
pytorch-examples-wlang-lstm 302.66 302.36 :white_check_mark: 0.10%
torchvision-resnet50_1 91.04 91.14 :white_check_mark: -0.11%
torchvision-inceptionv3_1 128.30 128.38 :white_check_mark: -0.07%
torchvision-vgg16_1 387.61 387.51 :white_check_mark: 0.03%
cadene-dpn92_1 120.82 120.91 :white_check_mark: -0.07%
cadene-resnext101_1 37.24 37.33 :white_check_mark: -0.25%
slim-vgg16_1 62.38 62.38 :white_check_mark: -0.00%
slim-mobilenet_1 1,713.90 1,716.22 :white_check_mark: -0.14%
slim-inceptionv4_1 59.03 59.07 :white_check_mark: -0.07%
onnx-taau-downsample 245.07 245.25 :white_check_mark: -0.07%

This build is not recommended to merge :red_circle:

vidojegavrilovichtec commented 2 years ago
Test Rate new
aa7ff9
Rate old
aa7ff9
Diff
torchvision-resnet50 1,933.21 1,933.07 :white_check_mark: 0.01%
torchvision-resnet50_fp16 4,684.32 4,689.88 :white_check_mark: -0.12%
torchvision-alexnet 4,701.73 4,701.01 :white_check_mark: 0.02%
torchvision-alexnet_fp16 24,684.31 24,656.16 :white_check_mark: 0.11%
torchvision-densenet121 1,194.78 1,196.06 :white_check_mark: -0.11%
torchvision-densenet121_fp16 2,358.94 2,362.69 :white_check_mark: -0.16%
torchvision-inceptionv3 991.01 990.97 :white_check_mark: 0.00%
torchvision-inceptionv3_fp16 1,891.51 1,890.04 :white_check_mark: 0.08%
torchvision-vgg16 779.89 780.12 :white_check_mark: -0.03%
torchvision-vgg16_fp16 1,785.73 1,785.55 :white_check_mark: 0.01%
cadene-inceptionv4 528.66 528.94 :white_check_mark: -0.05%
cadene-resnext64x4 491.47 491.19 :white_check_mark: 0.06%
slim-mobilenet 6,239.64 6,237.15 :white_check_mark: 0.04%
slim-nasnetalarge 172.82 172.82 :white_check_mark: -0.00%
slim-resnet50v2 2,201.24 2,202.77 :white_check_mark: -0.07%
bert-mrpc-onnx 585.33 584.59 :white_check_mark: 0.13%
bert-mrpc-tf 256.88 256.75 :white_check_mark: 0.05%
pytorch-examples-wlang-gru 213.15 213.88 :white_check_mark: -0.34%
pytorch-examples-wlang-lstm 303.69 302.66 :white_check_mark: 0.34%
torchvision-resnet50_1 91.09 91.04 :white_check_mark: 0.05%
torchvision-inceptionv3_1 128.16 128.30 :white_check_mark: -0.11%
torchvision-vgg16_1 387.81 387.61 :white_check_mark: 0.05%
cadene-dpn92_1 120.87 120.82 :white_check_mark: 0.04%
cadene-resnext101_1 37.29 37.24 :white_check_mark: 0.15%
slim-vgg16_1 62.37 62.38 :white_check_mark: -0.01%
slim-mobilenet_1 1,705.77 1,713.90 :white_check_mark: -0.47%
slim-inceptionv4_1 59.02 59.03 :white_check_mark: -0.03%
onnx-taau-downsample 245.32 245.07 :white_check_mark: 0.10%

This build is OK for merge :white_check_mark:

vidojegavrilovichtec commented 2 years ago
Test Rate new
aa7ff9
Rate old
aa7ff9
Diff
torchvision-resnet50 1,930.64 1,930.64 :white_check_mark: 0.00%
torchvision-resnet50_fp16 4,683.29 4,685.32 :white_check_mark: -0.04%
torchvision-alexnet 4,702.70 4,700.77 :white_check_mark: 0.04%
torchvision-alexnet_fp16 24,685.93 24,664.71 :white_check_mark: 0.09%
torchvision-densenet121 1,192.31 1,196.38 :white_check_mark: -0.34%
torchvision-densenet121_fp16 2,359.81 2,365.45 :white_check_mark: -0.24%
torchvision-inceptionv3 989.43 989.64 :white_check_mark: -0.02%
torchvision-inceptionv3_fp16 1,886.58 1,888.61 :white_check_mark: -0.11%
torchvision-vgg16 778.57 778.43 :white_check_mark: 0.02%
torchvision-vgg16_fp16 1,782.86 1,783.60 :white_check_mark: -0.04%
cadene-inceptionv4 528.13 528.80 :white_check_mark: -0.13%
cadene-resnext64x4 490.62 490.74 :white_check_mark: -0.02%
slim-mobilenet 6,228.65 6,237.82 :white_check_mark: -0.15%
slim-nasnetalarge 172.52 172.58 :white_check_mark: -0.03%
slim-resnet50v2 2,198.19 2,198.11 :white_check_mark: 0.00%
bert-mrpc-onnx 583.40 584.24 :white_check_mark: -0.14%
bert-mrpc-tf 256.73 257.57 :white_check_mark: -0.33%
pytorch-examples-wlang-gru 213.81 215.47 :white_check_mark: -0.77%
pytorch-examples-wlang-lstm 304.05 303.27 :white_check_mark: 0.26%
torchvision-resnet50_1 91.12 90.99 :white_check_mark: 0.14%
torchvision-inceptionv3_1 128.15 128.37 :white_check_mark: -0.18%
torchvision-vgg16_1 387.03 387.22 :white_check_mark: -0.05%
cadene-dpn92_1 120.83 121.10 :white_check_mark: -0.23%
cadene-resnext101_1 37.27 37.29 :white_check_mark: -0.07%
slim-vgg16_1 62.35 62.37 :white_check_mark: -0.02%
slim-mobilenet_1 1,711.03 1,714.45 :white_check_mark: -0.20%
slim-inceptionv4_1 59.01 59.11 :white_check_mark: -0.17%
onnx-taau-downsample 245.12 244.87 :white_check_mark: 0.10%

This build is OK for merge :white_check_mark:

vidojegavrilovichtec commented 2 years ago
Test Rate new
aa7ff9
Rate old
aa7ff9
Diff
torchvision-resnet50 1,932.66 1,932.96 :white_check_mark: -0.02%
torchvision-resnet50_fp16 4,680.69 4,689.06 :white_check_mark: -0.18%
torchvision-alexnet 4,698.21 4,704.22 :white_check_mark: -0.13%
torchvision-alexnet_fp16 24,706.61 24,660.82 :white_check_mark: 0.19%
torchvision-densenet121 1,194.75 1,195.04 :white_check_mark: -0.02%
torchvision-densenet121_fp16 2,362.91 2,361.82 :white_check_mark: 0.05%
torchvision-inceptionv3 990.76 990.87 :white_check_mark: -0.01%
torchvision-inceptionv3_fp16 1,889.25 1,889.86 :white_check_mark: -0.03%
torchvision-vgg16 780.02 779.84 :white_check_mark: 0.02%
torchvision-vgg16_fp16 1,785.42 1,784.51 :white_check_mark: 0.05%
cadene-inceptionv4 528.82 528.64 :white_check_mark: 0.03%
cadene-resnext64x4 491.41 491.26 :white_check_mark: 0.03%
slim-mobilenet 6,241.59 6,235.33 :white_check_mark: 0.10%
slim-nasnetalarge 172.88 172.76 :white_check_mark: 0.07%
slim-resnet50v2 2,202.94 2,201.86 :white_check_mark: 0.05%
bert-mrpc-onnx 584.94 585.13 :white_check_mark: -0.03%
bert-mrpc-tf 257.07 258.20 :white_check_mark: -0.43%
pytorch-examples-wlang-gru 213.83 214.07 :white_check_mark: -0.12%
pytorch-examples-wlang-lstm 303.16 303.03 :white_check_mark: 0.04%
torchvision-resnet50_1 91.18 91.04 :white_check_mark: 0.16%
torchvision-inceptionv3_1 128.31 128.27 :white_check_mark: 0.03%
torchvision-vgg16_1 387.72 387.60 :white_check_mark: 0.03%
cadene-dpn92_1 120.90 120.79 :white_check_mark: 0.09%
cadene-resnext101_1 37.34 37.31 :white_check_mark: 0.08%
slim-vgg16_1 62.37 62.39 :white_check_mark: -0.03%
slim-mobilenet_1 1,713.69 1,714.85 :white_check_mark: -0.07%
slim-inceptionv4_1 59.07 59.07 :white_check_mark: 0.00%
onnx-taau-downsample 245.29 245.20 :white_check_mark: 0.04%

This build is OK for merge :white_check_mark:

vidojegavrilovichtec commented 2 years ago
Test Rate new
c0398d
Rate old
c0398d
Diff
torchvision-resnet50 1,940.81 1,941.13 :white_check_mark: -0.02%
torchvision-resnet50_fp16 4,427.93 4,430.35 :white_check_mark: -0.05%
torchvision-alexnet 4,707.09 4,705.64 :white_check_mark: 0.03%
torchvision-alexnet_fp16 23,802.97 23,908.34 :red_circle: -0.44%
torchvision-densenet121 1,172.11 1,187.58 :red_circle: -1.30%
torchvision-densenet121_fp16 2,398.57 2,397.79 :white_check_mark: 0.03%
torchvision-inceptionv3 970.14 972.29 :red_circle: -0.22%
torchvision-inceptionv3_fp16 1,857.17 1,860.12 :white_check_mark: -0.16%
torchvision-vgg16 782.32 782.70 :white_check_mark: -0.05%
torchvision-vgg16_fp16 1,552.64 1,552.49 :white_check_mark: 0.01%
cadene-inceptionv4 463.96 464.36 :white_check_mark: -0.09%
cadene-resnext64x4 479.89 480.03 :white_check_mark: -0.03%
slim-mobilenet 6,350.21 6,347.63 :white_check_mark: 0.04%
slim-nasnetalarge 172.73 172.93 :white_check_mark: -0.12%
slim-resnet50v2 2,224.12 2,225.50 :white_check_mark: -0.06%
bert-mrpc-onnx 586.14 587.29 :white_check_mark: -0.20%
bert-mrpc-tf 257.88 256.89 :white_check_mark: 0.38%
pytorch-examples-wlang-gru 213.11 213.83 :white_check_mark: -0.34%
pytorch-examples-wlang-lstm 302.88 304.13 :white_check_mark: -0.41%
torchvision-resnet50_1 92.19 91.79 :white_check_mark: 0.44%
torchvision-inceptionv3_1 142.93 143.05 :white_check_mark: -0.08%
torchvision-vgg16_1 387.51 388.81 :white_check_mark: -0.33%
cadene-dpn92_1 121.27 122.41 :white_check_mark: -0.93%
cadene-resnext101_1 37.33 37.28 :white_check_mark: 0.11%
slim-vgg16_1 62.84 62.56 :white_check_mark: 0.45%
slim-mobilenet_1 1,852.30 1,848.88 :white_check_mark: 0.19%
slim-inceptionv4_1 64.21 64.20 :white_check_mark: 0.01%
onnx-taau-downsample 246.37 245.08 :white_check_mark: 0.53%

This build is not recommended to merge :red_circle:

migraphx-bot commented 2 years ago
Test Rate new
f5760e
Rate old
f5760e
Diff
torchvision-resnet50 1,941.31 1,940.65 :white_check_mark: 0.03%
torchvision-resnet50_fp16 4,426.65 4,427.53 :white_check_mark: -0.02%
torchvision-alexnet 4,712.33 4,707.79 :white_check_mark: 0.10%
torchvision-alexnet_fp16 23,834.08 23,867.95 :white_check_mark: -0.14%
torchvision-densenet121 1,157.60 1,186.64 :red_circle: -2.45%
torchvision-densenet121_fp16 2,342.76 2,407.43 :white_check_mark: -2.69%
torchvision-inceptionv3 969.63 971.88 :red_circle: -0.23%
torchvision-inceptionv3_fp16 1,862.53 1,864.71 :white_check_mark: -0.12%
torchvision-vgg16 782.89 782.48 :white_check_mark: 0.05%
torchvision-vgg16_fp16 1,552.72 1,552.18 :white_check_mark: 0.03%
cadene-inceptionv4 464.73 464.91 :white_check_mark: -0.04%
cadene-resnext64x4 480.17 480.17 :white_check_mark: -0.00%
slim-mobilenet 6,349.90 6,347.19 :white_check_mark: 0.04%
slim-nasnetalarge 172.86 172.78 :white_check_mark: 0.05%
slim-resnet50v2 2,224.28 2,224.51 :white_check_mark: -0.01%
bert-mrpc-onnx 586.54 586.77 :white_check_mark: -0.04%
bert-mrpc-tf 256.72 258.19 :white_check_mark: -0.57%
pytorch-examples-wlang-gru 213.72 213.08 :white_check_mark: 0.30%
pytorch-examples-wlang-lstm 303.08 302.98 :white_check_mark: 0.03%
torchvision-resnet50_1 92.02 91.99 :white_check_mark: 0.03%
torchvision-inceptionv3_1 142.61 143.02 :white_check_mark: -0.29%
torchvision-vgg16_1 388.68 388.60 :white_check_mark: 0.02%
cadene-dpn92_1 121.94 122.24 :white_check_mark: -0.25%
cadene-resnext101_1 37.32 37.35 :white_check_mark: -0.07%
slim-vgg16_1 62.55 62.55 :white_check_mark: -0.01%
slim-mobilenet_1 1,833.80 1,833.11 :white_check_mark: 0.04%
slim-inceptionv4_1 64.36 64.21 :white_check_mark: 0.23%
onnx-taau-downsample 245.71 246.36 :white_check_mark: -0.27%

This build is not recommended to merge :red_circle: