ROCm / AMDMIGraphX

AMD's graph optimization engine.
https://rocm.docs.amd.com/projects/AMDMIGraphX/en/latest/
MIT License
185 stars 86 forks source link

Always output a packed type for q/dq #3609

Closed pfultz2 closed 2 days ago

codecov[bot] commented 5 days ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 92.17%. Comparing base (1cfd6c2) to head (f2e2f90). Report is 7 commits behind head on develop.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## develop #3609 +/- ## =========================================== - Coverage 92.17% 92.17% -0.01% =========================================== Files 513 513 Lines 21560 21558 -2 =========================================== - Hits 19873 19871 -2 Misses 1687 1687 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

migraphx-bot commented 3 days ago
Test Batch Rate new
f2e2f9
Rate old
c51bea
Diff Compare
torchvision-resnet50 64 3,261.10 3,257.81 0.10% :white_check_mark:
torchvision-resnet50_fp16 64 6,988.97 6,987.81 0.02% :white_check_mark:
torchvision-densenet121 32 2,435.78 2,434.57 0.05% :white_check_mark:
torchvision-densenet121_fp16 32 4,089.51 4,065.61 0.59% :white_check_mark:
torchvision-inceptionv3 32 1,628.32 1,637.17 -0.54% :white_check_mark:
torchvision-inceptionv3_fp16 32 2,746.64 2,759.26 -0.46% :white_check_mark:
cadene-inceptionv4 16 764.15 776.31 -1.57% :white_check_mark:
cadene-resnext64x4 16 806.80 811.75 -0.61% :white_check_mark:
slim-mobilenet 64 7,465.46 7,533.16 -0.90% :white_check_mark:
slim-nasnetalarge 64 208.40 211.39 -1.41% :white_check_mark:
slim-resnet50v2 64 3,438.86 3,504.83 -1.88% :white_check_mark:
bert-mrpc-onnx 8 1,151.60 1,146.47 0.45% :white_check_mark:
bert-mrpc-tf 1 468.18 473.89 -1.21% :white_check_mark:
pytorch-examples-wlang-gru 1 425.12 425.31 -0.04% :white_check_mark:
pytorch-examples-wlang-lstm 1 384.16 408.68 -6.00% :red_circle:
torchvision-resnet50_1 1 786.18 771.75 1.87% :white_check_mark:
cadene-dpn92_1 1 399.58 399.01 0.14% :white_check_mark:
cadene-resnext101_1 1 384.59 383.85 0.19% :white_check_mark:
onnx-taau-downsample 1 345.54 343.09 0.71% :white_check_mark:
dlrm-criteoterabyte 1 33.33 33.31 0.06% :white_check_mark:
dlrm-criteoterabyte_fp16 1 52.73 52.71 0.05% :white_check_mark:
agentmodel 1 8,324.94 8,235.67 1.08% :white_check_mark:
unet_fp16 2 58.83 58.90 -0.12% :white_check_mark:
resnet50v1_fp16 1 1,020.60 940.89 8.47% :high_brightness:
resnet50v1_int8 1 1,017.56 1,025.93 -0.82% :white_check_mark:
bert_base_cased_fp16 64 1,169.33 1,170.88 -0.13% :white_check_mark:
bert_large_uncased_fp16 32 363.36 363.69 -0.09% :white_check_mark:
bert_large_fp16 1 198.83 200.14 -0.65% :white_check_mark:
distilgpt2_fp16 16 2,202.02 2,200.77 0.06% :white_check_mark:
yolov5s 1 533.35 535.15 -0.34% :white_check_mark:
tinyllama 1 43.71 43.41 0.69% :white_check_mark:
vicuna-fastchat 1 175.59 178.09 -1.41% :white_check_mark:
whisper-tiny-encoder 1 415.37 418.18 -0.67% :white_check_mark:
whisper-tiny-decoder 1 426.80 427.58 -0.18% :white_check_mark:

This build is not recommended to merge :red_circle:

migraphx-bot commented 3 days ago


     :white_check_mark: bert-mrpc-onnx: PASSED: MIGraphX meets tolerance
     :white_check_mark: bert-mrpc-tf: PASSED: MIGraphX meets tolerance
     :white_check_mark: pytorch-examples-wlang-gru: PASSED: MIGraphX meets tolerance
     :white_check_mark: pytorch-examples-wlang-lstm: PASSED: MIGraphX meets tolerance
     :white_check_mark: torchvision-resnet50_1: PASSED: MIGraphX meets tolerance
     :white_check_mark: cadene-dpn92_1: PASSED: MIGraphX meets tolerance
     :white_check_mark: cadene-resnext101_1: PASSED: MIGraphX meets tolerance
     :white_check_mark: dlrm-criteoterabyte: PASSED: MIGraphX meets tolerance
     :white_check_mark: agentmodel: PASSED: MIGraphX meets tolerance
     :white_check_mark: unet: PASSED: MIGraphX meets tolerance
     :white_check_mark: resnet50v1: PASSED: MIGraphX meets tolerance
     :white_check_mark: bert_base_cased_fp16: PASSED: MIGraphX meets tolerance
:red_circle:bert_large_uncased_fp16: FAILED: MIGraphX is not within tolerance - check verbose output

     :white_check_mark: bert_large: PASSED: MIGraphX meets tolerance
     :white_check_mark: yolov5s: PASSED: MIGraphX meets tolerance
     :white_check_mark: tinyllama: PASSED: MIGraphX meets tolerance
     :white_check_mark: vicuna-fastchat: PASSED: MIGraphX meets tolerance
     :white_check_mark: whisper-tiny-encoder: PASSED: MIGraphX meets tolerance
     :white_check_mark: whisper-tiny-decoder: PASSED: MIGraphX meets tolerance
     :white_check_mark: distilgpt2_fp16: PASSED: MIGraphX meets tolerance