migraphx-benchmark / AMDMIGraphX

AMD's graph optimization engine.
https://rocmsoftwareplatform.github.io/AMDMIGraphX/doc/html/
MIT License
0 stars 1 forks source link

Update requirements.txt #62

Closed pavlejacovicHTEC closed 1 year ago

pavlejacovicHTEC commented 1 year ago

Testing PR performance tests. Added change to rearrange models by batch size

migraphx-bot commented 1 year ago
Test Batch Rate new
383947
Rate old
f6e22d
Diff Compare
bert-mrpc-tf 1 306.17 359.59 -14.85% :red_circle:
pytorch-examples-wlang-gru 1 313.51 314.98 -0.47% :white_check_mark:
pytorch-examples-wlang-lstm 1 308.81 312.68 -1.24% :white_check_mark:
torchvision-resnet50_1 1 531.20 522.92 1.58% :white_check_mark:
torchvision-inceptionv3_1 1 298.25 297.38 0.29% :white_check_mark:
cadene-dpn92_1 1 326.59 328.64 -0.63% :white_check_mark:
cadene-resnext101_1 1 230.27 230.04 0.10% :white_check_mark:
slim-vgg16_1 1 157.98 158.22 -0.15% :white_check_mark:
slim-mobilenet_1 1 1,467.70 1,477.96 -0.69% :white_check_mark:
slim-inceptionv4_1 1 191.65 188.29 1.78% :white_check_mark:
onnx-taau-downsample 1 322.88 323.53 -0.20% :white_check_mark:
dlrm-criteoterabyte 1 20.93 20.95 -0.07% :white_check_mark:
dlrm-criteoterabyte_fp16 1 39.73 39.74 -0.03% :white_check_mark:
agentmodel 1 5,103.03 5,621.83 -9.23% :red_circle:
bert-mrpc-onnx 8 852.63 852.52 0.01% :white_check_mark:
cadene-inceptionv4 16 663.82 679.24 -2.27% :white_check_mark:
cadene-resnext64x4 16 592.29 592.06 0.04% :white_check_mark:
torchvision-densenet121 32 1,779.37 1,782.65 -0.18% :white_check_mark:
torchvision-densenet121_fp16 32 3,251.62 3,250.15 0.05% :white_check_mark:
torchvision-inceptionv3 32 1,310.23 1,309.07 0.09% :white_check_mark:
torchvision-inceptionv3_fp16 32 2,327.34 2,325.85 0.06% :white_check_mark:
torchvision-resnet50 64 2,260.76 2,262.34 -0.07% :white_check_mark:
torchvision-resnet50_fp16 64 5,272.87 5,235.52 0.71% :white_check_mark:
slim-mobilenet 64 7,159.25 7,151.49 0.11% :white_check_mark:
slim-nasnetalarge 64 228.69 228.73 -0.01% :white_check_mark:
slim-resnet50v2 64 2,349.29 2,346.79 0.11% :white_check_mark:

This build is not recommended to merge :red_circle:

migraphx-bot commented 1 year ago


    :white_check_mark:bert-mrpc-onnx: PASSED: MIGraphX meets tolerance
    :white_check_mark:bert-mrpc-tf: PASSED: MIGraphX meets tolerance
    :white_check_mark:pytorch-examples-wlang-gru: PASSED: MIGraphX meets tolerance
    :white_check_mark:pytorch-examples-wlang-lstm: PASSED: MIGraphX meets tolerance
    :white_check_mark:torchvision-resnet50_1: PASSED: MIGraphX meets tolerance
    :white_check_mark:torchvision-inceptionv3_1: PASSED: MIGraphX meets tolerance
    :white_check_mark:cadene-dpn92_1: PASSED: MIGraphX meets tolerance
    :white_check_mark:cadene-resnext101_1: PASSED: MIGraphX meets tolerance
    :white_check_mark:slim-vgg16_1: PASSED: MIGraphX meets tolerance
    :white_check_mark:slim-mobilenet_1: PASSED: MIGraphX meets tolerance
    :white_check_mark:slim-inceptionv4_1: PASSED: MIGraphX meets tolerance
    :white_check_mark:dlrm-criteoterabyte: PASSED: MIGraphX meets tolerance
    :white_check_mark:agentmodel: PASSED: MIGraphX meets tolerance