Closed IgorMirosavljevicHTEC closed 2 years ago
Test | Rate new 2783c6 |
Rate old ca8a54 |
Diff |
---|---|---|---|
torchvision-resnet50 | 2,200.59 | 2,144.48 | :white_check_mark: 2.62% |
torchvision-resnet50_fp16 | 4,735.83 | 4,733.27 | :white_check_mark: 0.05% |
torchvision-alexnet | 4,970.02 | 4,963.05 | :white_check_mark: 0.14% |
torchvision-alexnet_fp16 | 26,113.92 | 26,764.69 | :white_check_mark: -2.43% |
torchvision-densenet121 | 1,628.93 | 1,348.36 | :white_check_mark: 20.81% |
torchvision-densenet121_fp16 | 2,524.61 | 2,400.74 | :white_check_mark: 5.16% |
torchvision-inceptionv3 | 1,094.82 | 865.49 | :white_check_mark: 26.50% |
torchvision-inceptionv3_fp16 | 1,979.01 | 1,985.16 | :white_check_mark: -0.31% |
torchvision-vgg16 | 893.83 | 893.39 | :white_check_mark: 0.05% |
torchvision-vgg16_fp16 | 1,723.63 | 1,772.62 | :white_check_mark: -2.76% |
cadene-inceptionv4 | 525.92 | 503.66 | :white_check_mark: 4.42% |
cadene-resnext64x4 | 573.58 | 540.14 | :white_check_mark: 6.19% |
slim-mobilenet | 6,383.85 | 6,381.18 | :white_check_mark: 0.04% |
nan | nan | nan | :x: nan% |
nan | nan | nan | :x: nan% |
nan | nan | nan | :x: nan% |
nan | nan | nan | :x: nan% |
nan | nan | nan | :x: nan% |
nan | nan | nan | :x: nan% |
nan | nan | nan | :x: nan% |
nan | nan | nan | :x: nan% |
nan | nan | nan | :x: nan% |
nan | nan | nan | :x: nan% |
nan | nan | nan | :x: nan% |
nan | nan | nan | :x: nan% |
nan | nan | nan | :x: nan% |
nan | nan | nan | :x: nan% |
nan | nan | nan | :x: nan% |
This build is not recommended to merge :red_circle:
Test | Rate new ca8a54 |
Rate old 2783c6 |
Diff |
---|---|---|---|
torchvision-resnet50 | 2,143.21 | 2,200.59 | :white_check_mark: -2.61% |
torchvision-resnet50_fp16 | 4,740.85 | 4,735.83 | :white_check_mark: 0.11% |
torchvision-alexnet | 4,963.90 | 4,970.02 | :white_check_mark: -0.12% |
torchvision-alexnet_fp16 | 26,719.21 | 26,113.92 | :high_brightness: 2.32% |
torchvision-densenet121 | 1,348.25 | 1,628.93 | :white_check_mark: -17.23% |
torchvision-densenet121_fp16 | 572.76 | 2,524.61 | :white_check_mark: -77.31% |
torchvision-inceptionv3 | 1,300.33 | 1,094.82 | :white_check_mark: 18.77% |
torchvision-inceptionv3_fp16 | 1,981.03 | 1,979.01 | :white_check_mark: 0.10% |
torchvision-vgg16 | 893.21 | 893.83 | :white_check_mark: -0.07% |
torchvision-vgg16_fp16 | 1,772.00 | 1,723.63 | :white_check_mark: 2.81% |
cadene-inceptionv4 | 503.08 | 525.92 | :white_check_mark: -4.34% |
cadene-resnext64x4 | 539.96 | 573.58 | :white_check_mark: -5.86% |
slim-mobilenet | 6,390.99 | 6,383.85 | :white_check_mark: 0.11% |
slim-nasnetalarge | 188.07 | nan | :x: nan% |
slim-resnet50v2 | 2,394.96 | nan | :x: nan% |
bert-mrpc-onnx | 640.40 | nan | :x: nan% |
bert-mrpc-tf | 289.63 | nan | :x: nan% |
pytorch-examples-wlang-gru | 227.46 | nan | :x: nan% |
pytorch-examples-wlang-lstm | 304.08 | nan | :x: nan% |
torchvision-resnet50_1 | 95.56 | nan | :x: nan% |
torchvision-inceptionv3_1 | 155.99 | nan | :x: nan% |
torchvision-vgg16_1 | 459.58 | nan | :x: nan% |
cadene-dpn92_1 | 122.60 | nan | :x: nan% |
cadene-resnext101_1 | 37.70 | nan | :x: nan% |
slim-vgg16_1 | 63.73 | nan | :x: nan% |
slim-mobilenet_1 | 1,944.03 | nan | :x: nan% |
slim-inceptionv4_1 | 68.85 | nan | :x: nan% |
onnx-taau-downsample | 254.48 | nan | :x: nan% |
This build is not recommended to merge :red_circle:
Test | Rate new 6e6cb9 |
Rate old 6e6cb9 |
Diff |
---|---|---|---|
torchvision-resnet50 | 2,224.61 | 2,224.70 | :white_check_mark: -0.00% |
torchvision-resnet50_fp16 | 4,747.42 | 4,748.51 | :white_check_mark: -0.02% |
torchvision-alexnet | 4,978.14 | 4,976.87 | :white_check_mark: 0.03% |
torchvision-alexnet_fp16 | 26,370.66 | 26,241.45 | :white_check_mark: 0.49% |
torchvision-densenet121 | 1,635.73 | 1,637.36 | :white_check_mark: -0.10% |
torchvision-densenet121_fp16 | 2,530.26 | 2,527.01 | :white_check_mark: 0.13% |
torchvision-inceptionv3 | 1,097.04 | 1,094.91 | :white_check_mark: 0.19% |
torchvision-inceptionv3_fp16 | 1,989.04 | 1,979.87 | :white_check_mark: 0.46% |
torchvision-vgg16 | 896.06 | 896.17 | :white_check_mark: -0.01% |
torchvision-vgg16_fp16 | 1,727.20 | 1,726.87 | :white_check_mark: 0.02% |
cadene-inceptionv4 | 528.73 | 528.26 | :white_check_mark: 0.09% |
cadene-resnext64x4 | 577.71 | 577.98 | :white_check_mark: -0.05% |
slim-mobilenet | 6,396.87 | 6,400.00 | :white_check_mark: -0.05% |
slim-nasnetalarge | 203.26 | 203.45 | :white_check_mark: -0.09% |
slim-resnet50v2 | 2,429.90 | 2,432.77 | :white_check_mark: -0.12% |
bert-mrpc-onnx | 639.31 | 639.62 | :white_check_mark: -0.05% |
bert-mrpc-tf | 295.07 | 295.87 | :white_check_mark: -0.27% |
pytorch-examples-wlang-gru | 228.55 | 229.64 | :white_check_mark: -0.47% |
pytorch-examples-wlang-lstm | 306.85 | 306.36 | :white_check_mark: 0.16% |
torchvision-resnet50_1 | 512.03 | 516.19 | :white_check_mark: -0.81% |
torchvision-inceptionv3_1 | 302.73 | 303.27 | :white_check_mark: -0.18% |
torchvision-vgg16_1 | 463.05 | 463.57 | :white_check_mark: -0.11% |
cadene-dpn92_1 | 304.35 | 304.94 | :white_check_mark: -0.19% |
cadene-resnext101_1 | 237.41 | 238.44 | :white_check_mark: -0.43% |
slim-vgg16_1 | 64.03 | 64.01 | :white_check_mark: 0.04% |
slim-mobilenet_1 | 1,980.67 | 1,973.29 | :white_check_mark: 0.37% |
slim-inceptionv4_1 | 195.92 | 194.97 | :white_check_mark: 0.49% |
onnx-taau-downsample | 259.02 | 258.87 | :white_check_mark: 0.06% |
This build is OK for merge :white_check_mark:
Testing PR call