Open IgorMirosavljevicHTEC opened 2 years ago
Test | Rate new | Rate old | Diff |
---|---|---|---|
torchvision-resnet50 | 1,932.54 | 1,931.91 | :white_check_mark: 0.03% |
torchvision-resnet50_fp16 | 4,680.38 | 4,679.97 | :white_check_mark: 0.01% |
torchvision-alexnet | 4,698.63 | 4,702.04 | :red_circle: -0.07% |
torchvision-alexnet_fp16 | 24,658.35 | 24,735.83 | :red_circle: -0.31% |
torchvision-densenet121 | 1,192.42 | 1,192.29 | :white_check_mark: 0.01% |
torchvision-densenet121_fp16 | 2,373.13 | 2,376.97 | :red_circle: -0.16% |
torchvision-inceptionv3 | 990.57 | 990.08 | :white_check_mark: 0.05% |
torchvision-inceptionv3_fp16 | 1,889.62 | 1,889.67 | :red_circle: -0.00% |
torchvision-vgg16 | 779.94 | 779.95 | :red_circle: -0.00% |
torchvision-vgg16_fp16 | 1,789.51 | 1,789.55 | :red_circle: -0.00% |
cadene-inceptionv4 | 528.86 | 529.04 | :red_circle: -0.03% |
cadene-resnext64x4 | 489.44 | 489.50 | :red_circle: -0.01% |
slim-mobilenet | 6,240.25 | 6,238.73 | :white_check_mark: 0.02% |
slim-nasnetalarge | 172.59 | 172.61 | :red_circle: -0.01% |
slim-resnet50v2 | 2,194.46 | 2,194.76 | :red_circle: -0.01% |
bert-mrpc-onnx | 488.73 | 488.75 | :red_circle: -0.00% |
bert-mrpc-tf | 230.42 | 230.07 | :white_check_mark: 0.15% |
pytorchexamples-wlang-gru | 187.71 | 187.88 | :red_circle: -0.09% |
pytorchexamples-wlang-lstm | 305.48 | 305.54 | :red_circle: -0.02% |
torchvision-resnet50_1 | 91.19 | 90.93 | :white_check_mark: 0.28% |
torchvision-inceptionv3_1 | 128.03 | 127.95 | :white_check_mark: 0.06% |
torchvision-vgg16_1 | 387.31 | 387.23 | :white_check_mark: 0.02% |
cadene-dpn92_1 | 120.90 | 120.76 | :white_check_mark: 0.11% |
cadene-resnext101_1 | 37.36 | 37.26 | :white_check_mark: 0.27% |
slim-vgg16_1 | 62.37 | 62.38 | :red_circle: -0.01% |
slim-mobilenet_1 | 1,703.06 | 1,707.88 | :red_circle: -0.28% |
slim-inceptionv4_1 | 59.08 | 58.92 | :white_check_mark: 0.27% |
onnx-taau-downsample | 244.81 | 244.89 | :red_circle: -0.03% |
Test | Rate new | Rate old | Diff |
---|---|---|---|
torchvision-resnet50 | 1,933.00 | 1,312.21 | :white_check_mark: 47.31% |
torchvision-resnet50_fp16 | 4,679.32 | 4,671.46 | :white_check_mark: 0.17% |
torchvision-alexnet | 3,202.02 | 4,689.50 | :red_circle: -31.72% |
torchvision-alexnet_fp16 | 24,688.69 | 24,664.14 | :white_check_mark: 0.10% |
torchvision-densenet121 | 1,172.91 | 1,172.35 | :white_check_mark: 0.05% |
torchvision-densenet121_fp16 | 2,263.63 | 2,291.39 | :red_circle: -1.21% |
torchvision-inceptionv3 | 989.21 | 988.15 | :white_check_mark: 0.11% |
torchvision-inceptionv3_fp16 | 1,878.75 | 1,881.58 | :red_circle: -0.15% |
torchvision-vgg16 | 778.44 | 778.43 | :white_check_mark: 0.00% |
torchvision-vgg16_fp16 | 1,782.21 | 1,778.12 | :white_check_mark: 0.23% |
cadene-inceptionv4 | 524.95 | 357.23 | :white_check_mark: 46.95% |
cadene-resnext64x4 | 490.46 | 488.30 | :white_check_mark: 0.44% |
slim-mobilenet | 4,292.51 | 3,624.97 | :white_check_mark: 18.41% |
slim-nasnetalarge | 171.45 | 170.28 | :white_check_mark: 0.69% |
slim-resnet50v2 | 2,195.98 | 2,007.19 | :white_check_mark: 9.41% |
bert-mrpc-onnx | 217.52 | 484.02 | :red_circle: -55.06% |
bert-mrpc-tf | 131.61 | 222.25 | :red_circle: -40.78% |
pytorchexamples-wlang-gru | nan | 186.37 | nan |
pytorchexamples-wlang-lstm | 301.98 | 169.16 | :white_check_mark: 78.52% |
torchvision-resnet50_1 | 90.93 | 90.89 | :white_check_mark: 0.04% |
torchvision-inceptionv3_1 | 127.65 | 127.41 | :white_check_mark: 0.19% |
torchvision-vgg16_1 | 349.10 | 385.67 | :red_circle: -9.48% |
cadene-dpn92_1 | 118.35 | nan | nan |
cadene-resnext101_1 | 37.24 | nan | nan |
slim-vgg16_1 | 62.32 | nan | nan |
slim-mobilenet_1 | 1,714.75 | nan | nan |
slim-inceptionv4_1 | 58.91 | nan | nan |
onnx-taau-downsample | 245.08 | nan | nan |
Test | Rate new | Rate old | Diff | 1339ba | 1339ba | |||
---|---|---|---|---|---|---|---|---|
torchvision-resnet50 | 1,932.95 | 1,931.65 | :white_check_mark: 0.07% | |||||
torchvision-resnet50_fp16 | 4,686.82 | 4,682.37 | :white_check_mark: 0.10% | |||||
torchvision-alexnet | 4,697.63 | 4,697.08 | :white_check_mark: 0.01% | |||||
torchvision-alexnet_fp16 | 24,733.25 | 24,715.20 | :white_check_mark: 0.07% | |||||
torchvision-densenet121 | 1,195.55 | 1,173.11 | :white_check_mark: 1.91% | |||||
torchvision-densenet121_fp16 | 2,359.46 | 2,359.66 | :white_check_mark: -0.01% | |||||
torchvision-inceptionv3 | 991.84 | 991.23 | :white_check_mark: 0.06% | |||||
torchvision-inceptionv3_fp16 | 1,890.25 | 1,889.95 | :white_check_mark: 0.02% | |||||
torchvision-vgg16 | 779.51 | 779.54 | :white_check_mark: -0.00% | |||||
torchvision-vgg16_fp16 | 1,785.46 | 1,784.15 | :white_check_mark: 0.07% | |||||
cadene-inceptionv4 | 528.12 | 528.24 | :white_check_mark: -0.02% | |||||
cadene-resnext64x4 | 491.29 | 491.25 | :white_check_mark: 0.01% | |||||
slim-mobilenet | 6,239.76 | 6,241.35 | :white_check_mark: -0.03% | |||||
slim-nasnetalarge | 172.56 | 172.55 | :white_check_mark: 0.01% | |||||
slim-resnet50v2 | 2,199.30 | 2,198.65 | :white_check_mark: 0.03% | |||||
bert-mrpc-onnx | 583.09 | 583.01 | :white_check_mark: 0.01% | |||||
bert-mrpc-tf | 258.12 | 257.82 | :white_check_mark: 0.12% | |||||
pytorchexamples-wlang-gru | nan | nan | :x: nan% | |||||
pytorchexamples-wlang-lstm | 302.54 | 302.73 | :white_check_mark: -0.06% | |||||
torchvision-resnet50_1 | 91.13 | 91.07 | :white_check_mark: 0.07% | |||||
torchvision-inceptionv3_1 | 128.34 | 128.20 | :white_check_mark: 0.11% | |||||
torchvision-vgg16_1 | 387.36 | 387.29 | :white_check_mark: 0.02% | |||||
cadene-dpn92_1 | 121.09 | 120.90 | :white_check_mark: 0.15% | |||||
cadene-resnext101_1 | 37.28 | 37.25 | :white_check_mark: 0.08% | |||||
slim-vgg16_1 | 62.37 | 62.37 | :white_check_mark: 0.00% | |||||
slim-mobilenet_1 | 1,712.20 | 1,718.64 | :white_check_mark: -0.37% | |||||
slim-inceptionv4_1 | 59.07 | 59.14 | :white_check_mark: -0.11% | |||||
onnx-taau-downsample | 245.10 | 245.14 | :white_check_mark: -0.02% |
This build is not recommended to merge :red_circle:
Test | Rate new 7271dd | Rate old 7271dd | Diff |
---|---|---|---|
torchvision-resnet50 | 1,930.19 | 1,933.40 | :white_check_mark: -0.17% |
torchvision-resnet50_fp16 | 4,677.54 | 4,687.00 | :white_check_mark: -0.20% |
torchvision-alexnet | 4,698.66 | 4,701.32 | :white_check_mark: -0.06% |
torchvision-alexnet_fp16 | 24,711.47 | 24,657.02 | :high_brightness: 0.22% |
torchvision-densenet121 | 595.41 | 501.98 | :high_brightness: 18.61% |
torchvision-densenet121_fp16 | 2,229.47 | 2,280.16 | :white_check_mark: -2.22% |
torchvision-inceptionv3 | 978.28 | 715.60 | :high_brightness: 36.71% |
torchvision-inceptionv3_fp16 | 1,881.28 | 1,880.82 | :white_check_mark: 0.02% |
torchvision-vgg16 | 777.60 | 777.17 | :white_check_mark: 0.06% |
torchvision-vgg16_fp16 | 1,778.49 | 1,782.06 | :white_check_mark: -0.20% |
cadene-inceptionv4 | 247.08 | 525.14 | :red_circle: -52.95% |
cadene-resnext64x4 | 233.48 | 490.58 | :red_circle: -52.41% |
slim-mobilenet | 6,165.35 | 6,219.15 | :white_check_mark: -0.87% |
slim-nasnetalarge | 166.67 | 172.00 | :white_check_mark: -3.10% |
slim-resnet50v2 | 2,195.24 | 1,395.58 | :high_brightness: 57.30% |
bert-mrpc-onnx | 578.51 | 578.33 | :white_check_mark: 0.03% |
bert-mrpc-tf | 254.72 | 254.39 | :white_check_mark: 0.13% |
pytorchexamples-wlang-gru | nan | nan | :x: nan% |
pytorchexamples-wlang-lstm | 300.75 | 96.28 | :high_brightness: 212.38% |
torchvision-resnet50_1 | 90.97 | 90.71 | :white_check_mark: 0.28% |
torchvision-inceptionv3_1 | 127.27 | 74.88 | :high_brightness: 69.95% |
torchvision-vgg16_1 | 386.05 | 375.70 | :high_brightness: 2.75% |
cadene-dpn92_1 | 119.55 | 119.74 | :white_check_mark: -0.16% |
nan | nan | nan | :x: nan% |
nan | nan | nan | :x: nan% |
nan | nan | nan | :x: nan% |
nan | nan | nan | :x: nan% |
nan | nan | nan | :x: nan% |
This build is not recommended to merge :red_circle:
Test | Rate new 7271dd |
Rate old 7271dd |
Diff |
---|---|---|---|
torchvision-resnet50 | 1,929.58 | 1,930.19 | :white_check_mark: -0.03% |
torchvision-resnet50_fp16 | 4,677.78 | 4,677.54 | :white_check_mark: 0.01% |
torchvision-alexnet | 4,696.39 | 4,698.66 | :white_check_mark: -0.05% |
torchvision-alexnet_fp16 | 24,725.22 | 24,711.47 | :white_check_mark: 0.06% |
torchvision-densenet121 | 1,196.81 | 595.41 | :high_brightness: 101.00% |
torchvision-densenet121_fp16 | 2,361.07 | 2,229.47 | :white_check_mark: 5.90% |
torchvision-inceptionv3 | 991.53 | 978.28 | :high_brightness: 1.35% |
torchvision-inceptionv3_fp16 | 1,890.09 | 1,881.28 | :white_check_mark: 0.47% |
torchvision-vgg16 | 779.50 | 777.60 | :white_check_mark: 0.24% |
torchvision-vgg16_fp16 | 1,785.38 | 1,778.49 | :white_check_mark: 0.39% |
cadene-inceptionv4 | 528.46 | 247.08 | :high_brightness: 113.88% |
cadene-resnext64x4 | 491.22 | 233.48 | :high_brightness: 110.39% |
slim-mobilenet | 6,245.61 | 6,165.35 | :white_check_mark: 1.30% |
slim-nasnetalarge | 172.60 | 166.67 | :white_check_mark: 3.56% |
slim-resnet50v2 | 2,199.59 | 2,195.24 | :white_check_mark: 0.20% |
bert-mrpc-onnx | 583.08 | 578.51 | :white_check_mark: 0.79% |
bert-mrpc-tf | 258.04 | 254.72 | :white_check_mark: 1.30% |
pytorchexamples-wlang-gru | nan | nan | :x: nan% |
pytorchexamples-wlang-lstm | 301.99 | 300.75 | :white_check_mark: 0.41% |
torchvision-resnet50_1 | 91.05 | 90.97 | :white_check_mark: 0.08% |
torchvision-inceptionv3_1 | 128.21 | 127.27 | :white_check_mark: 0.75% |
torchvision-vgg16_1 | 387.44 | 386.05 | :white_check_mark: 0.36% |
cadene-dpn92_1 | 121.08 | 119.55 | :white_check_mark: 1.28% |
cadene-resnext101_1 | 37.31 | 37.18 | :white_check_mark: 0.35% |
slim-vgg16_1 | 62.37 | 52.57 | :white_check_mark: 18.65% |
slim-mobilenet_1 | 1,714.95 | 1,715.20 | :white_check_mark: -0.01% |
slim-inceptionv4_1 | 59.04 | 58.89 | :white_check_mark: 0.26% |
onnx-taau-downsample | 245.12 | 244.80 | :white_check_mark: 0.13% |
This build is not recommended to merge :red_circle:
Test | Rate new 7271dd |
Rate old 7271dd |
Diff |
---|---|---|---|
torchvision-resnet50 | 1,932.90 | 1,929.58 | :white_check_mark: 0.17% |
torchvision-resnet50_fp16 | 4,686.52 | 4,677.78 | :white_check_mark: 0.19% |
torchvision-alexnet | 4,701.63 | 4,696.39 | :white_check_mark: 0.11% |
torchvision-alexnet_fp16 | 24,661.77 | 24,725.22 | :red_circle: -0.26% |
torchvision-densenet121 | 1,194.79 | 1,196.81 | :white_check_mark: -0.17% |
torchvision-densenet121_fp16 | 2,358.58 | 2,361.07 | :white_check_mark: -0.11% |
torchvision-inceptionv3 | 991.54 | 991.53 | :white_check_mark: 0.00% |
torchvision-inceptionv3_fp16 | 1,889.50 | 1,890.09 | :white_check_mark: -0.03% |
torchvision-vgg16 | 779.72 | 779.50 | :white_check_mark: 0.03% |
torchvision-vgg16_fp16 | 1,784.83 | 1,785.38 | :white_check_mark: -0.03% |
cadene-inceptionv4 | 528.29 | 528.46 | :white_check_mark: -0.03% |
cadene-resnext64x4 | 491.18 | 491.22 | :white_check_mark: -0.01% |
slim-mobilenet | 6,238.06 | 6,245.61 | :white_check_mark: -0.12% |
slim-nasnetalarge | 172.56 | 172.60 | :white_check_mark: -0.03% |
slim-resnet50v2 | 2,198.81 | 2,199.59 | :white_check_mark: -0.04% |
bert-mrpc-onnx | 583.23 | 583.08 | :white_check_mark: 0.02% |
bert-mrpc-tf | 257.93 | 258.04 | :white_check_mark: -0.04% |
pytorchexamples-wlang-gru | nan | nan | :x: nan% |
pytorchexamples-wlang-lstm | 302.26 | 301.99 | :white_check_mark: 0.09% |
torchvision-resnet50_1 | 91.13 | 91.05 | :white_check_mark: 0.09% |
torchvision-inceptionv3_1 | 128.18 | 128.21 | :white_check_mark: -0.02% |
torchvision-vgg16_1 | 387.27 | 387.44 | :white_check_mark: -0.04% |
cadene-dpn92_1 | 121.05 | 121.08 | :white_check_mark: -0.03% |
cadene-resnext101_1 | 37.34 | 37.31 | :white_check_mark: 0.07% |
slim-vgg16_1 | 62.37 | 62.37 | :white_check_mark: -0.01% |
slim-mobilenet_1 | 1,713.75 | 1,714.95 | :white_check_mark: -0.07% |
slim-inceptionv4_1 | 59.02 | 59.04 | :white_check_mark: -0.04% |
onnx-taau-downsample | 245.05 | 245.12 | :white_check_mark: -0.03% |
This build is not recommended to merge :red_circle:
Test | Rate new f55d7c |
Rate old 7271dd |
Diff |
---|---|---|---|
torchvision-resnet50 | 1,932.26 | 1,932.96 | :white_check_mark: -0.04% |
torchvision-resnet50_fp16 | 4,680.69 | 4,687.82 | :white_check_mark: -0.15% |
torchvision-alexnet | 4,699.70 | 4,700.70 | :white_check_mark: -0.02% |
torchvision-alexnet_fp16 | 24,663.95 | 24,659.30 | :white_check_mark: 0.02% |
torchvision-densenet121 | 1,193.93 | 1,195.99 | :white_check_mark: -0.17% |
torchvision-densenet121_fp16 | 2,373.52 | 2,360.30 | :white_check_mark: 0.56% |
torchvision-inceptionv3 | 990.91 | 991.88 | :white_check_mark: -0.10% |
torchvision-inceptionv3_fp16 | 1,890.73 | 1,890.07 | :white_check_mark: 0.03% |
torchvision-vgg16 | 780.10 | 779.73 | :white_check_mark: 0.05% |
torchvision-vgg16_fp16 | 1,790.26 | 1,784.93 | :white_check_mark: 0.30% |
cadene-inceptionv4 | 528.91 | 528.28 | :white_check_mark: 0.12% |
cadene-resnext64x4 | 489.59 | 491.18 | :white_check_mark: -0.32% |
slim-mobilenet | 6,235.26 | 6,236.48 | :white_check_mark: -0.02% |
slim-nasnetalarge | 172.59 | 172.49 | :white_check_mark: 0.06% |
slim-resnet50v2 | 2,194.83 | 2,200.57 | :white_check_mark: -0.26% |
bert-mrpc-onnx | 488.62 | 583.23 | :red_circle: -16.22% |
bert-mrpc-tf | 230.00 | 259.10 | :white_check_mark: -11.23% |
pytorchexamples-wlang-gru | 183.74 | nan | :x: nan% |
pytorchexamples-wlang-lstm | 306.44 | 302.21 | :white_check_mark: 1.40% |
torchvision-resnet50_1 | 90.94 | 91.15 | :white_check_mark: -0.24% |
torchvision-inceptionv3_1 | 127.87 | 128.24 | :white_check_mark: -0.29% |
torchvision-vgg16_1 | 387.27 | 387.51 | :white_check_mark: -0.06% |
cadene-dpn92_1 | 120.84 | 121.19 | :white_check_mark: -0.29% |
cadene-resnext101_1 | 37.25 | 37.33 | :white_check_mark: -0.22% |
slim-vgg16_1 | 62.37 | 62.37 | :white_check_mark: 0.00% |
slim-mobilenet_1 | 1,702.06 | 1,711.70 | :white_check_mark: -0.56% |
slim-inceptionv4_1 | 59.03 | 59.18 | :white_check_mark: -0.25% |
onnx-taau-downsample | 244.27 | 245.46 | :white_check_mark: -0.49% |
This build is not recommended to merge :red_circle:
Test | Rate new f55d7c |
Rate old f55d7c |
Diff |
---|---|---|---|
torchvision-resnet50 | 1,932.11 | 1,931.88 | :white_check_mark: 0.01% |
torchvision-resnet50_fp16 | 4,677.34 | 4,677.37 | :white_check_mark: -0.00% |
torchvision-alexnet | 4,699.42 | 4,699.46 | :white_check_mark: -0.00% |
torchvision-alexnet_fp16 | 24,660.44 | 24,664.05 | :white_check_mark: -0.01% |
torchvision-densenet121 | 1,193.92 | 1,194.18 | :white_check_mark: -0.02% |
torchvision-densenet121_fp16 | 2,375.31 | 2,376.36 | :white_check_mark: -0.04% |
torchvision-inceptionv3 | 990.46 | 990.57 | :white_check_mark: -0.01% |
torchvision-inceptionv3_fp16 | 1,889.25 | 1,890.46 | :white_check_mark: -0.06% |
torchvision-vgg16 | 779.64 | 779.64 | :white_check_mark: 0.00% |
torchvision-vgg16_fp16 | 1,790.19 | 1,789.73 | :white_check_mark: 0.03% |
cadene-inceptionv4 | 529.17 | 528.75 | :white_check_mark: 0.08% |
cadene-resnext64x4 | 489.44 | 489.36 | :white_check_mark: 0.02% |
slim-mobilenet | 6,237.39 | 6,236.54 | :white_check_mark: 0.01% |
slim-nasnetalarge | 172.54 | 172.56 | :white_check_mark: -0.01% |
slim-resnet50v2 | 2,193.53 | 2,194.40 | :white_check_mark: -0.04% |
bert-mrpc-onnx | 488.67 | 488.56 | :white_check_mark: 0.02% |
bert-mrpc-tf | 229.80 | 230.57 | :white_check_mark: -0.33% |
pytorchexamples-wlang-gru | 189.50 | 187.98 | :white_check_mark: 0.81% |
pytorchexamples-wlang-lstm | 305.39 | 305.13 | :white_check_mark: 0.08% |
torchvision-resnet50_1 | 91.03 | 90.85 | :white_check_mark: 0.20% |
torchvision-inceptionv3_1 | 127.95 | 127.85 | :white_check_mark: 0.08% |
torchvision-vgg16_1 | 387.24 | 387.34 | :white_check_mark: -0.02% |
cadene-dpn92_1 | 120.92 | 121.24 | :white_check_mark: -0.26% |
cadene-resnext101_1 | 37.28 | 37.30 | :white_check_mark: -0.06% |
slim-vgg16_1 | 62.36 | 62.38 | :white_check_mark: -0.03% |
slim-mobilenet_1 | 1,701.75 | 1,703.49 | :white_check_mark: -0.10% |
slim-inceptionv4_1 | 59.02 | 59.03 | :white_check_mark: -0.02% |
onnx-taau-downsample | 244.28 | 244.61 | :white_check_mark: -0.13% |
This build is OK for merge :white_check_mark:
Test | Rate new 37c475 |
Rate old 7271dd |
Diff |
---|---|---|---|
torchvision-resnet50 | 1,933.14 | 1,929.14 | :white_check_mark: 0.21% |
torchvision-resnet50_fp16 | 4,687.07 | 4,681.44 | :white_check_mark: 0.12% |
torchvision-alexnet | 4,701.80 | 4,703.01 | :white_check_mark: -0.03% |
torchvision-alexnet_fp16 | 24,659.30 | 24,724.46 | :red_circle: -0.26% |
torchvision-densenet121 | 1,195.10 | 1,169.03 | :high_brightness: 2.23% |
torchvision-densenet121_fp16 | 2,358.75 | 2,247.96 | :white_check_mark: 4.93% |
torchvision-inceptionv3 | 991.45 | 987.44 | :high_brightness: 0.41% |
torchvision-inceptionv3_fp16 | 1,890.21 | 1,859.89 | :white_check_mark: 1.63% |
torchvision-vgg16 | 779.84 | 779.86 | :white_check_mark: -0.00% |
torchvision-vgg16_fp16 | 1,785.16 | 1,783.70 | :white_check_mark: 0.08% |
cadene-inceptionv4 | 527.11 | 526.81 | :white_check_mark: 0.06% |
cadene-resnext64x4 | 490.77 | 490.43 | :white_check_mark: 0.07% |
slim-mobilenet | 6,232.90 | 6,230.83 | :white_check_mark: 0.03% |
slim-nasnetalarge | 172.34 | 172.24 | :white_check_mark: 0.06% |
slim-resnet50v2 | 2,200.36 | 2,202.75 | :white_check_mark: -0.11% |
bert-mrpc-onnx | 581.24 | 580.18 | :white_check_mark: 0.18% |
bert-mrpc-tf | 252.17 | 258.91 | :white_check_mark: -2.60% |
pytorchexamples-wlang-gru | nan | nan | :x: nan% |
pytorchexamples-wlang-lstm | 301.02 | 302.03 | :white_check_mark: -0.33% |
torchvision-resnet50_1 | 90.81 | 91.06 | :white_check_mark: -0.28% |
torchvision-inceptionv3_1 | 126.82 | 127.67 | :white_check_mark: -0.67% |
torchvision-vgg16_1 | 387.14 | 387.12 | :white_check_mark: 0.01% |
cadene-dpn92_1 | 118.09 | 118.89 | :white_check_mark: -0.68% |
cadene-resnext101_1 | 37.24 | 37.28 | :white_check_mark: -0.11% |
slim-vgg16_1 | 62.36 | 62.36 | :white_check_mark: -0.01% |
slim-mobilenet_1 | 1,711.93 | 1,710.38 | :white_check_mark: 0.09% |
slim-inceptionv4_1 | 58.82 | 58.56 | :white_check_mark: 0.44% |
onnx-taau-downsample | 244.37 | 245.35 | :white_check_mark: -0.40% |
This build is not recommended to merge :red_circle:
Test | Rate new aa7ff9 |
Rate old aa7ff9 |
Diff |
---|---|---|---|
torchvision-resnet50 | 1,933.07 | 1,933.11 | :white_check_mark: -0.00% |
torchvision-resnet50_fp16 | 4,689.88 | 4,687.48 | :white_check_mark: 0.05% |
torchvision-alexnet | 4,701.01 | 4,703.22 | :white_check_mark: -0.05% |
torchvision-alexnet_fp16 | 24,656.16 | 24,671.46 | :white_check_mark: -0.06% |
torchvision-densenet121 | 1,196.06 | 1,196.29 | :white_check_mark: -0.02% |
torchvision-densenet121_fp16 | 2,362.69 | 2,358.26 | :white_check_mark: 0.19% |
torchvision-inceptionv3 | 990.97 | 990.42 | :white_check_mark: 0.06% |
torchvision-inceptionv3_fp16 | 1,890.04 | 1,891.42 | :white_check_mark: -0.07% |
torchvision-vgg16 | 780.12 | 779.86 | :white_check_mark: 0.03% |
torchvision-vgg16_fp16 | 1,785.55 | 1,785.28 | :white_check_mark: 0.01% |
cadene-inceptionv4 | 528.94 | 527.71 | :white_check_mark: 0.23% |
cadene-resnext64x4 | 491.19 | 491.24 | :white_check_mark: -0.01% |
slim-mobilenet | 6,237.15 | 6,241.10 | :white_check_mark: -0.06% |
slim-nasnetalarge | 172.82 | 172.65 | :white_check_mark: 0.10% |
slim-resnet50v2 | 2,202.77 | 2,201.86 | :white_check_mark: 0.04% |
bert-mrpc-onnx | 584.59 | 583.69 | :white_check_mark: 0.15% |
bert-mrpc-tf | 256.75 | 257.54 | :white_check_mark: -0.31% |
pytorch-examples-wlang-gru | 213.88 | nan | :x: nan% |
pytorch-examples-wlang-lstm | 302.66 | 302.36 | :white_check_mark: 0.10% |
torchvision-resnet50_1 | 91.04 | 91.14 | :white_check_mark: -0.11% |
torchvision-inceptionv3_1 | 128.30 | 128.38 | :white_check_mark: -0.07% |
torchvision-vgg16_1 | 387.61 | 387.51 | :white_check_mark: 0.03% |
cadene-dpn92_1 | 120.82 | 120.91 | :white_check_mark: -0.07% |
cadene-resnext101_1 | 37.24 | 37.33 | :white_check_mark: -0.25% |
slim-vgg16_1 | 62.38 | 62.38 | :white_check_mark: -0.00% |
slim-mobilenet_1 | 1,713.90 | 1,716.22 | :white_check_mark: -0.14% |
slim-inceptionv4_1 | 59.03 | 59.07 | :white_check_mark: -0.07% |
onnx-taau-downsample | 245.07 | 245.25 | :white_check_mark: -0.07% |
This build is not recommended to merge :red_circle:
Test | Rate new aa7ff9 |
Rate old aa7ff9 |
Diff |
---|---|---|---|
torchvision-resnet50 | 1,933.21 | 1,933.07 | :white_check_mark: 0.01% |
torchvision-resnet50_fp16 | 4,684.32 | 4,689.88 | :white_check_mark: -0.12% |
torchvision-alexnet | 4,701.73 | 4,701.01 | :white_check_mark: 0.02% |
torchvision-alexnet_fp16 | 24,684.31 | 24,656.16 | :white_check_mark: 0.11% |
torchvision-densenet121 | 1,194.78 | 1,196.06 | :white_check_mark: -0.11% |
torchvision-densenet121_fp16 | 2,358.94 | 2,362.69 | :white_check_mark: -0.16% |
torchvision-inceptionv3 | 991.01 | 990.97 | :white_check_mark: 0.00% |
torchvision-inceptionv3_fp16 | 1,891.51 | 1,890.04 | :white_check_mark: 0.08% |
torchvision-vgg16 | 779.89 | 780.12 | :white_check_mark: -0.03% |
torchvision-vgg16_fp16 | 1,785.73 | 1,785.55 | :white_check_mark: 0.01% |
cadene-inceptionv4 | 528.66 | 528.94 | :white_check_mark: -0.05% |
cadene-resnext64x4 | 491.47 | 491.19 | :white_check_mark: 0.06% |
slim-mobilenet | 6,239.64 | 6,237.15 | :white_check_mark: 0.04% |
slim-nasnetalarge | 172.82 | 172.82 | :white_check_mark: -0.00% |
slim-resnet50v2 | 2,201.24 | 2,202.77 | :white_check_mark: -0.07% |
bert-mrpc-onnx | 585.33 | 584.59 | :white_check_mark: 0.13% |
bert-mrpc-tf | 256.88 | 256.75 | :white_check_mark: 0.05% |
pytorch-examples-wlang-gru | 213.15 | 213.88 | :white_check_mark: -0.34% |
pytorch-examples-wlang-lstm | 303.69 | 302.66 | :white_check_mark: 0.34% |
torchvision-resnet50_1 | 91.09 | 91.04 | :white_check_mark: 0.05% |
torchvision-inceptionv3_1 | 128.16 | 128.30 | :white_check_mark: -0.11% |
torchvision-vgg16_1 | 387.81 | 387.61 | :white_check_mark: 0.05% |
cadene-dpn92_1 | 120.87 | 120.82 | :white_check_mark: 0.04% |
cadene-resnext101_1 | 37.29 | 37.24 | :white_check_mark: 0.15% |
slim-vgg16_1 | 62.37 | 62.38 | :white_check_mark: -0.01% |
slim-mobilenet_1 | 1,705.77 | 1,713.90 | :white_check_mark: -0.47% |
slim-inceptionv4_1 | 59.02 | 59.03 | :white_check_mark: -0.03% |
onnx-taau-downsample | 245.32 | 245.07 | :white_check_mark: 0.10% |
This build is OK for merge :white_check_mark:
Test | Rate new aa7ff9 |
Rate old aa7ff9 |
Diff |
---|---|---|---|
torchvision-resnet50 | 1,930.64 | 1,930.64 | :white_check_mark: 0.00% |
torchvision-resnet50_fp16 | 4,683.29 | 4,685.32 | :white_check_mark: -0.04% |
torchvision-alexnet | 4,702.70 | 4,700.77 | :white_check_mark: 0.04% |
torchvision-alexnet_fp16 | 24,685.93 | 24,664.71 | :white_check_mark: 0.09% |
torchvision-densenet121 | 1,192.31 | 1,196.38 | :white_check_mark: -0.34% |
torchvision-densenet121_fp16 | 2,359.81 | 2,365.45 | :white_check_mark: -0.24% |
torchvision-inceptionv3 | 989.43 | 989.64 | :white_check_mark: -0.02% |
torchvision-inceptionv3_fp16 | 1,886.58 | 1,888.61 | :white_check_mark: -0.11% |
torchvision-vgg16 | 778.57 | 778.43 | :white_check_mark: 0.02% |
torchvision-vgg16_fp16 | 1,782.86 | 1,783.60 | :white_check_mark: -0.04% |
cadene-inceptionv4 | 528.13 | 528.80 | :white_check_mark: -0.13% |
cadene-resnext64x4 | 490.62 | 490.74 | :white_check_mark: -0.02% |
slim-mobilenet | 6,228.65 | 6,237.82 | :white_check_mark: -0.15% |
slim-nasnetalarge | 172.52 | 172.58 | :white_check_mark: -0.03% |
slim-resnet50v2 | 2,198.19 | 2,198.11 | :white_check_mark: 0.00% |
bert-mrpc-onnx | 583.40 | 584.24 | :white_check_mark: -0.14% |
bert-mrpc-tf | 256.73 | 257.57 | :white_check_mark: -0.33% |
pytorch-examples-wlang-gru | 213.81 | 215.47 | :white_check_mark: -0.77% |
pytorch-examples-wlang-lstm | 304.05 | 303.27 | :white_check_mark: 0.26% |
torchvision-resnet50_1 | 91.12 | 90.99 | :white_check_mark: 0.14% |
torchvision-inceptionv3_1 | 128.15 | 128.37 | :white_check_mark: -0.18% |
torchvision-vgg16_1 | 387.03 | 387.22 | :white_check_mark: -0.05% |
cadene-dpn92_1 | 120.83 | 121.10 | :white_check_mark: -0.23% |
cadene-resnext101_1 | 37.27 | 37.29 | :white_check_mark: -0.07% |
slim-vgg16_1 | 62.35 | 62.37 | :white_check_mark: -0.02% |
slim-mobilenet_1 | 1,711.03 | 1,714.45 | :white_check_mark: -0.20% |
slim-inceptionv4_1 | 59.01 | 59.11 | :white_check_mark: -0.17% |
onnx-taau-downsample | 245.12 | 244.87 | :white_check_mark: 0.10% |
This build is OK for merge :white_check_mark:
Test | Rate new aa7ff9 |
Rate old aa7ff9 |
Diff |
---|---|---|---|
torchvision-resnet50 | 1,932.66 | 1,932.96 | :white_check_mark: -0.02% |
torchvision-resnet50_fp16 | 4,680.69 | 4,689.06 | :white_check_mark: -0.18% |
torchvision-alexnet | 4,698.21 | 4,704.22 | :white_check_mark: -0.13% |
torchvision-alexnet_fp16 | 24,706.61 | 24,660.82 | :white_check_mark: 0.19% |
torchvision-densenet121 | 1,194.75 | 1,195.04 | :white_check_mark: -0.02% |
torchvision-densenet121_fp16 | 2,362.91 | 2,361.82 | :white_check_mark: 0.05% |
torchvision-inceptionv3 | 990.76 | 990.87 | :white_check_mark: -0.01% |
torchvision-inceptionv3_fp16 | 1,889.25 | 1,889.86 | :white_check_mark: -0.03% |
torchvision-vgg16 | 780.02 | 779.84 | :white_check_mark: 0.02% |
torchvision-vgg16_fp16 | 1,785.42 | 1,784.51 | :white_check_mark: 0.05% |
cadene-inceptionv4 | 528.82 | 528.64 | :white_check_mark: 0.03% |
cadene-resnext64x4 | 491.41 | 491.26 | :white_check_mark: 0.03% |
slim-mobilenet | 6,241.59 | 6,235.33 | :white_check_mark: 0.10% |
slim-nasnetalarge | 172.88 | 172.76 | :white_check_mark: 0.07% |
slim-resnet50v2 | 2,202.94 | 2,201.86 | :white_check_mark: 0.05% |
bert-mrpc-onnx | 584.94 | 585.13 | :white_check_mark: -0.03% |
bert-mrpc-tf | 257.07 | 258.20 | :white_check_mark: -0.43% |
pytorch-examples-wlang-gru | 213.83 | 214.07 | :white_check_mark: -0.12% |
pytorch-examples-wlang-lstm | 303.16 | 303.03 | :white_check_mark: 0.04% |
torchvision-resnet50_1 | 91.18 | 91.04 | :white_check_mark: 0.16% |
torchvision-inceptionv3_1 | 128.31 | 128.27 | :white_check_mark: 0.03% |
torchvision-vgg16_1 | 387.72 | 387.60 | :white_check_mark: 0.03% |
cadene-dpn92_1 | 120.90 | 120.79 | :white_check_mark: 0.09% |
cadene-resnext101_1 | 37.34 | 37.31 | :white_check_mark: 0.08% |
slim-vgg16_1 | 62.37 | 62.39 | :white_check_mark: -0.03% |
slim-mobilenet_1 | 1,713.69 | 1,714.85 | :white_check_mark: -0.07% |
slim-inceptionv4_1 | 59.07 | 59.07 | :white_check_mark: 0.00% |
onnx-taau-downsample | 245.29 | 245.20 | :white_check_mark: 0.04% |
This build is OK for merge :white_check_mark:
Test | Rate new c0398d |
Rate old c0398d |
Diff |
---|---|---|---|
torchvision-resnet50 | 1,940.81 | 1,941.13 | :white_check_mark: -0.02% |
torchvision-resnet50_fp16 | 4,427.93 | 4,430.35 | :white_check_mark: -0.05% |
torchvision-alexnet | 4,707.09 | 4,705.64 | :white_check_mark: 0.03% |
torchvision-alexnet_fp16 | 23,802.97 | 23,908.34 | :red_circle: -0.44% |
torchvision-densenet121 | 1,172.11 | 1,187.58 | :red_circle: -1.30% |
torchvision-densenet121_fp16 | 2,398.57 | 2,397.79 | :white_check_mark: 0.03% |
torchvision-inceptionv3 | 970.14 | 972.29 | :red_circle: -0.22% |
torchvision-inceptionv3_fp16 | 1,857.17 | 1,860.12 | :white_check_mark: -0.16% |
torchvision-vgg16 | 782.32 | 782.70 | :white_check_mark: -0.05% |
torchvision-vgg16_fp16 | 1,552.64 | 1,552.49 | :white_check_mark: 0.01% |
cadene-inceptionv4 | 463.96 | 464.36 | :white_check_mark: -0.09% |
cadene-resnext64x4 | 479.89 | 480.03 | :white_check_mark: -0.03% |
slim-mobilenet | 6,350.21 | 6,347.63 | :white_check_mark: 0.04% |
slim-nasnetalarge | 172.73 | 172.93 | :white_check_mark: -0.12% |
slim-resnet50v2 | 2,224.12 | 2,225.50 | :white_check_mark: -0.06% |
bert-mrpc-onnx | 586.14 | 587.29 | :white_check_mark: -0.20% |
bert-mrpc-tf | 257.88 | 256.89 | :white_check_mark: 0.38% |
pytorch-examples-wlang-gru | 213.11 | 213.83 | :white_check_mark: -0.34% |
pytorch-examples-wlang-lstm | 302.88 | 304.13 | :white_check_mark: -0.41% |
torchvision-resnet50_1 | 92.19 | 91.79 | :white_check_mark: 0.44% |
torchvision-inceptionv3_1 | 142.93 | 143.05 | :white_check_mark: -0.08% |
torchvision-vgg16_1 | 387.51 | 388.81 | :white_check_mark: -0.33% |
cadene-dpn92_1 | 121.27 | 122.41 | :white_check_mark: -0.93% |
cadene-resnext101_1 | 37.33 | 37.28 | :white_check_mark: 0.11% |
slim-vgg16_1 | 62.84 | 62.56 | :white_check_mark: 0.45% |
slim-mobilenet_1 | 1,852.30 | 1,848.88 | :white_check_mark: 0.19% |
slim-inceptionv4_1 | 64.21 | 64.20 | :white_check_mark: 0.01% |
onnx-taau-downsample | 246.37 | 245.08 | :white_check_mark: 0.53% |
This build is not recommended to merge :red_circle:
Test | Rate new f5760e |
Rate old f5760e |
Diff |
---|---|---|---|
torchvision-resnet50 | 1,941.31 | 1,940.65 | :white_check_mark: 0.03% |
torchvision-resnet50_fp16 | 4,426.65 | 4,427.53 | :white_check_mark: -0.02% |
torchvision-alexnet | 4,712.33 | 4,707.79 | :white_check_mark: 0.10% |
torchvision-alexnet_fp16 | 23,834.08 | 23,867.95 | :white_check_mark: -0.14% |
torchvision-densenet121 | 1,157.60 | 1,186.64 | :red_circle: -2.45% |
torchvision-densenet121_fp16 | 2,342.76 | 2,407.43 | :white_check_mark: -2.69% |
torchvision-inceptionv3 | 969.63 | 971.88 | :red_circle: -0.23% |
torchvision-inceptionv3_fp16 | 1,862.53 | 1,864.71 | :white_check_mark: -0.12% |
torchvision-vgg16 | 782.89 | 782.48 | :white_check_mark: 0.05% |
torchvision-vgg16_fp16 | 1,552.72 | 1,552.18 | :white_check_mark: 0.03% |
cadene-inceptionv4 | 464.73 | 464.91 | :white_check_mark: -0.04% |
cadene-resnext64x4 | 480.17 | 480.17 | :white_check_mark: -0.00% |
slim-mobilenet | 6,349.90 | 6,347.19 | :white_check_mark: 0.04% |
slim-nasnetalarge | 172.86 | 172.78 | :white_check_mark: 0.05% |
slim-resnet50v2 | 2,224.28 | 2,224.51 | :white_check_mark: -0.01% |
bert-mrpc-onnx | 586.54 | 586.77 | :white_check_mark: -0.04% |
bert-mrpc-tf | 256.72 | 258.19 | :white_check_mark: -0.57% |
pytorch-examples-wlang-gru | 213.72 | 213.08 | :white_check_mark: 0.30% |
pytorch-examples-wlang-lstm | 303.08 | 302.98 | :white_check_mark: 0.03% |
torchvision-resnet50_1 | 92.02 | 91.99 | :white_check_mark: 0.03% |
torchvision-inceptionv3_1 | 142.61 | 143.02 | :white_check_mark: -0.29% |
torchvision-vgg16_1 | 388.68 | 388.60 | :white_check_mark: 0.02% |
cadene-dpn92_1 | 121.94 | 122.24 | :white_check_mark: -0.25% |
cadene-resnext101_1 | 37.32 | 37.35 | :white_check_mark: -0.07% |
slim-vgg16_1 | 62.55 | 62.55 | :white_check_mark: -0.01% |
slim-mobilenet_1 | 1,833.80 | 1,833.11 | :white_check_mark: 0.04% |
slim-inceptionv4_1 | 64.36 | 64.21 | :white_check_mark: 0.23% |
onnx-taau-downsample | 245.71 | 246.36 | :white_check_mark: -0.27% |
This build is not recommended to merge :red_circle: