ROCm / AMDMIGraphX

AMD's graph optimization engine.
https://rocm.docs.amd.com/projects/AMDMIGraphX/en/latest/
MIT License
183 stars 84 forks source link

Add flag to disable pass #3462

Open pfultz2 opened 1 week ago

codecov[bot] commented 1 week ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 92.02%. Comparing base (b57b1e4) to head (a608a08).

Additional details and impacted files ```diff @@ Coverage Diff @@ ## develop #3462 +/- ## ======================================== Coverage 92.02% 92.02% ======================================== Files 508 508 Lines 20948 20951 +3 ======================================== + Hits 19278 19281 +3 Misses 1670 1670 ``` | [Flag](https://app.codecov.io/gh/ROCm/AMDMIGraphX/pull/3462/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ROCm) | Coverage Δ | | |---|---|---| | [](https://app.codecov.io/gh/ROCm/AMDMIGraphX/pull/3462/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ROCm) | `92.02% <100.00%> (+<0.01%)` | :arrow_up: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ROCm#carryforward-flags-in-the-pull-request-comment) to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

migraphx-bot commented 1 week ago
Test Batch Rate new
982023
Rate old
8f4609
Diff Compare
torchvision-resnet50 64 3,251.74 3,251.92 -0.01% :white_check_mark:
torchvision-resnet50_fp16 64 6,992.14 6,998.28 -0.09% :white_check_mark:
torchvision-densenet121 32 2,435.22 2,432.52 0.11% :white_check_mark:
torchvision-densenet121_fp16 32 4,106.55 4,099.88 0.16% :white_check_mark:
torchvision-inceptionv3 32 1,636.60 1,635.33 0.08% :white_check_mark:
torchvision-inceptionv3_fp16 32 2,735.44 2,739.96 -0.16% :white_check_mark:
cadene-inceptionv4 16 777.18 776.37 0.10% :white_check_mark:
cadene-resnext64x4 16 808.30 807.99 0.04% :white_check_mark:
slim-mobilenet 64 7,460.90 7,454.13 0.09% :white_check_mark:
slim-nasnetalarge 64 208.33 208.25 0.04% :white_check_mark:
slim-resnet50v2 64 3,435.49 3,434.40 0.03% :white_check_mark:
bert-mrpc-onnx 8 1,153.66 1,157.86 -0.36% :white_check_mark:
bert-mrpc-tf 1 313.48 315.65 -0.69% :white_check_mark:
pytorch-examples-wlang-gru 1 416.87 421.77 -1.16% :white_check_mark:
pytorch-examples-wlang-lstm 1 394.87 445.90 -11.45% :red_circle:
torchvision-resnet50_1 1 773.00 777.66 -0.60% :white_check_mark:
cadene-dpn92_1 1 400.23 402.10 -0.47% :white_check_mark:
cadene-resnext101_1 1 382.71 383.76 -0.27% :white_check_mark:
onnx-taau-downsample 1 344.70 345.21 -0.15% :white_check_mark:
dlrm-criteoterabyte 1 35.09 35.07 0.06% :white_check_mark:
dlrm-criteoterabyte_fp16 1 58.12 58.12 0.00% :white_check_mark:
agentmodel 1 7,736.17 7,818.98 -1.06% :white_check_mark:
unet_fp16 2 58.58 58.66 -0.13% :white_check_mark:
resnet50v1_fp16 1 1,029.06 927.13 10.99% :high_brightness:
resnet50v1_int8 1 931.63 935.97 -0.46% :white_check_mark:
bert_base_cased_fp16 64 1,153.62 1,154.27 -0.06% :white_check_mark:
bert_large_uncased_fp16 32 356.01 355.93 0.02% :white_check_mark:
bert_large_fp16 1 214.08 214.22 -0.07% :white_check_mark:
distilgpt2_fp16 16 2,163.63 2,163.12 0.02% :white_check_mark:
yolov5s 1 535.46 537.49 -0.38% :white_check_mark:
tinyllama 1 43.46 43.49 -0.06% :white_check_mark:
vicuna-fastchat 1 166.45 173.51 -4.07% :red_circle:
whisper-tiny-encoder 1 417.85 417.99 -0.03% :white_check_mark:
whisper-tiny-decoder 1 430.77 425.01 1.35% :white_check_mark:

This build is not recommended to merge :red_circle:

migraphx-bot commented 1 week ago


     :white_check_mark: bert-mrpc-onnx: PASSED: MIGraphX meets tolerance
     :white_check_mark: bert-mrpc-tf: PASSED: MIGraphX meets tolerance
     :white_check_mark: pytorch-examples-wlang-gru: PASSED: MIGraphX meets tolerance
     :white_check_mark: pytorch-examples-wlang-lstm: PASSED: MIGraphX meets tolerance
     :white_check_mark: torchvision-resnet50_1: PASSED: MIGraphX meets tolerance
     :white_check_mark: cadene-dpn92_1: PASSED: MIGraphX meets tolerance
     :white_check_mark: cadene-resnext101_1: PASSED: MIGraphX meets tolerance
     :white_check_mark: dlrm-criteoterabyte: PASSED: MIGraphX meets tolerance
     :white_check_mark: agentmodel: PASSED: MIGraphX meets tolerance
     :white_check_mark: unet: PASSED: MIGraphX meets tolerance
     :white_check_mark: resnet50v1: PASSED: MIGraphX meets tolerance
     :white_check_mark: bert_base_cased_fp16: PASSED: MIGraphX meets tolerance
:red_circle:bert_large_uncased_fp16: FAILED: MIGraphX is not within tolerance - check verbose output

     :white_check_mark: bert_large: PASSED: MIGraphX meets tolerance
     :white_check_mark: yolov5s: PASSED: MIGraphX meets tolerance
     :white_check_mark: tinyllama: PASSED: MIGraphX meets tolerance
     :white_check_mark: vicuna-fastchat: PASSED: MIGraphX meets tolerance
     :white_check_mark: whisper-tiny-encoder: PASSED: MIGraphX meets tolerance
     :white_check_mark: whisper-tiny-decoder: PASSED: MIGraphX meets tolerance
     :white_check_mark: distilgpt2_fp16: PASSED: MIGraphX meets tolerance