ROCm / AMDMIGraphX

AMD's graph optimization engine.
https://rocm.docs.amd.com/projects/AMDMIGraphX/en/latest/
MIT License
185 stars 86 forks source link

rocMLIR Weekly Sync 2024-11-10 #3608

Closed github-actions[bot] closed 3 days ago

github-actions[bot] commented 6 days ago

Update rocMLIR version

github-actions[bot] commented 6 days ago
model DEFAULT MLIR_EXTENDED
bert-mrpc-onnx :white_check_mark: :red_circle:
bert-mrpc-tf :white_check_mark: :white_check_mark:
pytorch-examples-wlang-gru :white_check_mark: :white_check_mark:
pytorch-examples-wlang-lstm :white_check_mark: :white_check_mark:
torchvision-resnet50_1 :white_check_mark: :white_check_mark:
cadene-dpn92_1 :white_check_mark: :white_check_mark:
cadene-resnext101_1 :white_check_mark: :white_check_mark:
dlrm-criteoterabyte :white_check_mark: :white_check_mark:
agentmodel :white_check_mark: :white_check_mark:
unet :white_check_mark: :red_circle:
resnet50v1 :white_check_mark: :white_check_mark:
bert_base_cased_fp16 :white_check_mark: :white_check_mark:
bert_large_uncased_fp16 :red_circle: :white_check_mark:
bert_large :white_check_mark: :white_check_mark:
yolov5s :white_check_mark: :white_check_mark:
tinyllama :white_check_mark: :white_check_mark:
vicuna-fastchat :white_check_mark: :white_check_mark:
whisper-tiny-encoder :white_check_mark: :red_circle:
whisper-tiny-decoder :white_check_mark: :white_check_mark:
distilgpt2_fp16 :white_check_mark: :white_check_mark:

:white_check_mark: - within tolerance :red_circle: - not within tolerance :x: - error in execution

migraphx-bot commented 3 days ago
Test Batch Rate new
e315c0
Rate old
c51bea
Diff Compare
torchvision-resnet50 64 3,256.58 3,257.81 -0.04% :white_check_mark:
torchvision-resnet50_fp16 64 6,979.68 6,987.81 -0.12% :white_check_mark:
torchvision-densenet121 32 2,435.78 2,434.57 0.05% :white_check_mark:
torchvision-densenet121_fp16 32 4,093.65 4,065.61 0.69% :white_check_mark:
torchvision-inceptionv3 32 1,627.18 1,637.17 -0.61% :white_check_mark:
torchvision-inceptionv3_fp16 32 2,744.00 2,759.26 -0.55% :white_check_mark:
cadene-inceptionv4 16 764.64 776.31 -1.50% :white_check_mark:
cadene-resnext64x4 16 811.31 811.75 -0.05% :white_check_mark:
slim-mobilenet 64 7,463.49 7,533.16 -0.92% :white_check_mark:
slim-nasnetalarge 64 208.34 211.39 -1.44% :white_check_mark:
slim-resnet50v2 64 3,440.31 3,504.83 -1.84% :white_check_mark:
bert-mrpc-onnx 8 1,149.50 1,146.47 0.26% :white_check_mark:
bert-mrpc-tf 1 463.19 473.89 -2.26% :white_check_mark:
pytorch-examples-wlang-gru 1 421.43 425.31 -0.91% :white_check_mark:
pytorch-examples-wlang-lstm 1 395.22 408.68 -3.29% :red_circle:
torchvision-resnet50_1 1 804.04 771.75 4.18% :high_brightness:
cadene-dpn92_1 1 398.53 399.01 -0.12% :white_check_mark:
cadene-resnext101_1 1 382.92 383.85 -0.24% :white_check_mark:
onnx-taau-downsample 1 345.37 343.09 0.66% :white_check_mark:
dlrm-criteoterabyte 1 33.31 33.31 0.01% :white_check_mark:
dlrm-criteoterabyte_fp16 1 52.74 52.71 0.06% :white_check_mark:
agentmodel 1 8,382.37 8,235.67 1.78% :white_check_mark:
unet_fp16 2 58.76 58.90 -0.24% :white_check_mark:
resnet50v1_fp16 1 946.66 940.89 0.61% :white_check_mark:
resnet50v1_int8 1 1,016.56 1,025.93 -0.91% :white_check_mark:
bert_base_cased_fp16 64 1,171.39 1,170.88 0.04% :white_check_mark:
bert_large_uncased_fp16 32 363.64 363.69 -0.01% :white_check_mark:
bert_large_fp16 1 198.82 200.14 -0.66% :white_check_mark:
distilgpt2_fp16 16 2,199.34 2,200.77 -0.07% :white_check_mark:
yolov5s 1 542.01 535.15 1.28% :white_check_mark:
tinyllama 1 43.74 43.41 0.76% :white_check_mark:
vicuna-fastchat 1 175.88 178.09 -1.24% :white_check_mark:
whisper-tiny-encoder 1 418.72 418.18 0.13% :white_check_mark:
whisper-tiny-decoder 1 427.27 427.58 -0.07% :white_check_mark:

This build is not recommended to merge :red_circle:

migraphx-bot commented 3 days ago


     :white_check_mark: bert-mrpc-onnx: PASSED: MIGraphX meets tolerance
     :white_check_mark: bert-mrpc-tf: PASSED: MIGraphX meets tolerance
     :white_check_mark: pytorch-examples-wlang-gru: PASSED: MIGraphX meets tolerance
     :white_check_mark: pytorch-examples-wlang-lstm: PASSED: MIGraphX meets tolerance
     :white_check_mark: torchvision-resnet50_1: PASSED: MIGraphX meets tolerance
     :white_check_mark: cadene-dpn92_1: PASSED: MIGraphX meets tolerance
     :white_check_mark: cadene-resnext101_1: PASSED: MIGraphX meets tolerance
     :white_check_mark: dlrm-criteoterabyte: PASSED: MIGraphX meets tolerance
     :white_check_mark: agentmodel: PASSED: MIGraphX meets tolerance
     :white_check_mark: unet: PASSED: MIGraphX meets tolerance
     :white_check_mark: resnet50v1: PASSED: MIGraphX meets tolerance
     :white_check_mark: bert_base_cased_fp16: PASSED: MIGraphX meets tolerance
:red_circle:bert_large_uncased_fp16: FAILED: MIGraphX is not within tolerance - check verbose output

     :white_check_mark: bert_large: PASSED: MIGraphX meets tolerance
     :white_check_mark: yolov5s: PASSED: MIGraphX meets tolerance
     :white_check_mark: tinyllama: PASSED: MIGraphX meets tolerance
     :white_check_mark: vicuna-fastchat: PASSED: MIGraphX meets tolerance
     :white_check_mark: whisper-tiny-encoder: PASSED: MIGraphX meets tolerance
     :white_check_mark: whisper-tiny-decoder: PASSED: MIGraphX meets tolerance
     :white_check_mark: distilgpt2_fp16: PASSED: MIGraphX meets tolerance

codecov[bot] commented 3 days ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 92.17%. Comparing base (2f97579) to head (e315c0d). Report is 6 commits behind head on develop.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## develop #3608 +/- ## =========================================== - Coverage 92.18% 92.17% -0.01% =========================================== Files 513 513 Lines 21548 21560 +12 =========================================== + Hits 19863 19873 +10 - Misses 1685 1687 +2 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.