Closed pavlejacovicHTEC closed 1 year ago
Test | Batch | Rate new e0dee0 |
Rate old 09aaa6 |
Diff | Compare |
---|---|---|---|---|---|
torchvision-resnet50 | 64 | 2,263.84 | 2,263.05 | 0.03% | :white_check_mark: |
torchvision-resnet50_fp16 | 64 | 5,273.18 | 5,277.00 | -0.07% | :white_check_mark: |
torchvision-densenet121 | 32 | 1,783.98 | 1,780.65 | 0.19% | :white_check_mark: |
torchvision-densenet121_fp16 | 32 | 3,246.83 | 3,247.59 | -0.02% | :white_check_mark: |
torchvision-inceptionv3 | 32 | 1,313.34 | 1,313.69 | -0.03% | :white_check_mark: |
torchvision-inceptionv3_fp16 | 32 | 2,329.22 | 2,319.09 | 0.44% | :white_check_mark: |
cadene-inceptionv4 | 16 | 666.95 | 672.36 | -0.80% | :white_check_mark: |
cadene-resnext64x4 | 16 | 592.40 | 592.50 | -0.02% | :white_check_mark: |
slim-mobilenet | 64 | 7,152.16 | 7,157.20 | -0.07% | :white_check_mark: |
slim-nasnetalarge | 64 | 228.77 | 229.68 | -0.40% | :white_check_mark: |
slim-resnet50v2 | 64 | 2,348.36 | 2,348.31 | 0.00% | :white_check_mark: |
bert-mrpc-onnx | 8 | 852.03 | 851.63 | 0.05% | :white_check_mark: |
bert-mrpc-tf | 1 | 304.93 | 306.20 | -0.41% | :white_check_mark: |
pytorch-examples-wlang-gru | 1 | 317.00 | 313.18 | 1.22% | :white_check_mark: |
pytorch-examples-wlang-lstm | 1 | 316.13 | 310.18 | 1.92% | :white_check_mark: |
torchvision-resnet50_1 | 1 | 531.15 | 526.19 | 0.94% | :white_check_mark: |
torchvision-inceptionv3_1 | 1 | 299.54 | 298.83 | 0.24% | :white_check_mark: |
cadene-dpn92_1 | 1 | 326.05 | 329.27 | -0.98% | :white_check_mark: |
cadene-resnext101_1 | 1 | 230.35 | 229.85 | 0.22% | :white_check_mark: |
slim-vgg16_1 | 1 | 158.34 | 158.17 | 0.11% | :white_check_mark: |
slim-mobilenet_1 | 1 | 1,547.64 | 1,484.70 | 4.24% | :high_brightness: |
slim-inceptionv4_1 | 1 | 190.94 | 189.76 | 0.62% | :white_check_mark: |
onnx-taau-downsample | 1 | 323.49 | 323.24 | 0.08% | :white_check_mark: |
dlrm-criteoterabyte | 1 | nan | 20.84 | nan% | :x: |
dlrm-criteoterabyte_fp16 | 1 | nan | 39.46 | nan% | :x: |
agentmodel | 1 | 5,037.30 | 5,040.58 | -0.06% | :white_check_mark: |
This build is not recommended to merge :red_circle:
Testing new logic for model removal