Closed pavlejacovicHTEC closed 1 year ago
Test | Batch | Rate new 383947 |
Rate old f6e22d |
Diff | Compare |
---|---|---|---|---|---|
bert-mrpc-tf | 1 | 306.17 | 359.59 | -14.85% | :red_circle: |
pytorch-examples-wlang-gru | 1 | 313.51 | 314.98 | -0.47% | :white_check_mark: |
pytorch-examples-wlang-lstm | 1 | 308.81 | 312.68 | -1.24% | :white_check_mark: |
torchvision-resnet50_1 | 1 | 531.20 | 522.92 | 1.58% | :white_check_mark: |
torchvision-inceptionv3_1 | 1 | 298.25 | 297.38 | 0.29% | :white_check_mark: |
cadene-dpn92_1 | 1 | 326.59 | 328.64 | -0.63% | :white_check_mark: |
cadene-resnext101_1 | 1 | 230.27 | 230.04 | 0.10% | :white_check_mark: |
slim-vgg16_1 | 1 | 157.98 | 158.22 | -0.15% | :white_check_mark: |
slim-mobilenet_1 | 1 | 1,467.70 | 1,477.96 | -0.69% | :white_check_mark: |
slim-inceptionv4_1 | 1 | 191.65 | 188.29 | 1.78% | :white_check_mark: |
onnx-taau-downsample | 1 | 322.88 | 323.53 | -0.20% | :white_check_mark: |
dlrm-criteoterabyte | 1 | 20.93 | 20.95 | -0.07% | :white_check_mark: |
dlrm-criteoterabyte_fp16 | 1 | 39.73 | 39.74 | -0.03% | :white_check_mark: |
agentmodel | 1 | 5,103.03 | 5,621.83 | -9.23% | :red_circle: |
bert-mrpc-onnx | 8 | 852.63 | 852.52 | 0.01% | :white_check_mark: |
cadene-inceptionv4 | 16 | 663.82 | 679.24 | -2.27% | :white_check_mark: |
cadene-resnext64x4 | 16 | 592.29 | 592.06 | 0.04% | :white_check_mark: |
torchvision-densenet121 | 32 | 1,779.37 | 1,782.65 | -0.18% | :white_check_mark: |
torchvision-densenet121_fp16 | 32 | 3,251.62 | 3,250.15 | 0.05% | :white_check_mark: |
torchvision-inceptionv3 | 32 | 1,310.23 | 1,309.07 | 0.09% | :white_check_mark: |
torchvision-inceptionv3_fp16 | 32 | 2,327.34 | 2,325.85 | 0.06% | :white_check_mark: |
torchvision-resnet50 | 64 | 2,260.76 | 2,262.34 | -0.07% | :white_check_mark: |
torchvision-resnet50_fp16 | 64 | 5,272.87 | 5,235.52 | 0.71% | :white_check_mark: |
slim-mobilenet | 64 | 7,159.25 | 7,151.49 | 0.11% | :white_check_mark: |
slim-nasnetalarge | 64 | 228.69 | 228.73 | -0.01% | :white_check_mark: |
slim-resnet50v2 | 64 | 2,349.29 | 2,346.79 | 0.11% | :white_check_mark: |
This build is not recommended to merge :red_circle:
Testing PR performance tests. Added change to rearrange models by batch size