ROCm / AMDMIGraphX

AMD's graph optimization engine.
https://rocm.docs.amd.com/projects/AMDMIGraphX/en/latest/
MIT License
183 stars 84 forks source link

Increase iterations in optimize_module #3451

Closed pfultz2 closed 1 week ago

codecov[bot] commented 1 week ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 92.05%. Comparing base (7c2fdf5) to head (5efabe4). Report is 9 commits behind head on develop.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## develop #3451 +/- ## ========================================= Coverage 92.04% 92.05% ========================================= Files 505 506 +1 Lines 20699 20837 +138 ========================================= + Hits 19052 19181 +129 - Misses 1647 1656 +9 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

migraphx-bot commented 1 week ago
Test Batch Rate new
5efabe
Rate old
7c2fdf
Diff Compare
torchvision-resnet50 64 3,252.23 3,249.19 0.09% :white_check_mark:
torchvision-resnet50_fp16 64 6,989.90 6,993.27 -0.05% :white_check_mark:
torchvision-densenet121 32 2,433.79 2,434.31 -0.02% :white_check_mark:
torchvision-densenet121_fp16 32 4,061.38 4,095.02 -0.82% :white_check_mark:
torchvision-inceptionv3 32 1,636.41 1,635.79 0.04% :white_check_mark:
torchvision-inceptionv3_fp16 32 2,739.77 2,740.83 -0.04% :white_check_mark:
cadene-inceptionv4 16 777.34 776.76 0.07% :white_check_mark:
cadene-resnext64x4 16 809.12 808.72 0.05% :white_check_mark:
slim-mobilenet 64 7,460.25 7,455.28 0.07% :white_check_mark:
slim-nasnetalarge 64 208.56 208.38 0.09% :white_check_mark:
slim-resnet50v2 64 3,434.60 3,435.08 -0.01% :white_check_mark:
bert-mrpc-onnx 8 1,145.27 1,150.34 -0.44% :white_check_mark:
bert-mrpc-tf 1 309.87 314.36 -1.43% :white_check_mark:
pytorch-examples-wlang-gru 1 413.42 418.46 -1.20% :white_check_mark:
pytorch-examples-wlang-lstm 1 382.45 499.68 -23.46% :red_circle:
torchvision-resnet50_1 1 814.50 772.72 5.41% :high_brightness:
cadene-dpn92_1 1 432.72 397.74 8.80% :high_brightness:
cadene-resnext101_1 1 383.64 383.61 0.01% :white_check_mark:
onnx-taau-downsample 1 344.49 344.76 -0.08% :white_check_mark:
dlrm-criteoterabyte 1 32.90 35.10 -6.27% :red_circle:
dlrm-criteoterabyte_fp16 1 53.63 58.12 -7.73% :red_circle:
agentmodel 1 7,834.17 7,932.67 -1.24% :white_check_mark:
unet_fp16 2 58.06 57.85 0.36% :white_check_mark:
resnet50v1_fp16 1 940.32 935.68 0.50% :white_check_mark:
resnet50v1_int8 1 1,006.79 949.99 5.98% :high_brightness:
bert_base_cased_fp16 64 1,153.39 1,153.06 0.03% :white_check_mark:
bert_large_uncased_fp16 32 355.70 355.77 -0.02% :white_check_mark:
bert_large_fp16 1 209.85 210.32 -0.23% :white_check_mark:
distilgpt2_fp16 16 2,160.43 2,161.65 -0.06% :white_check_mark:
yolov5s 1 537.83 534.27 0.67% :white_check_mark:
tinyllama 1 43.23 43.40 -0.39% :white_check_mark:
vicuna-fastchat 1 172.35 170.43 1.13% :white_check_mark:
whisper-tiny-encoder 1 417.05 418.17 -0.27% :white_check_mark:
whisper-tiny-decoder 1 431.27 426.09 1.22% :white_check_mark:

This build is not recommended to merge :red_circle:

migraphx-bot commented 1 week ago


     :white_check_mark: bert-mrpc-onnx: PASSED: MIGraphX meets tolerance
     :white_check_mark: bert-mrpc-tf: PASSED: MIGraphX meets tolerance
     :white_check_mark: pytorch-examples-wlang-gru: PASSED: MIGraphX meets tolerance
     :white_check_mark: pytorch-examples-wlang-lstm: PASSED: MIGraphX meets tolerance
     :white_check_mark: torchvision-resnet50_1: PASSED: MIGraphX meets tolerance
     :white_check_mark: cadene-dpn92_1: PASSED: MIGraphX meets tolerance
     :white_check_mark: cadene-resnext101_1: PASSED: MIGraphX meets tolerance
     :white_check_mark: dlrm-criteoterabyte: PASSED: MIGraphX meets tolerance
     :white_check_mark: agentmodel: PASSED: MIGraphX meets tolerance
     :white_check_mark: unet: PASSED: MIGraphX meets tolerance
     :white_check_mark: resnet50v1: PASSED: MIGraphX meets tolerance
     :white_check_mark: bert_base_cased_fp16: PASSED: MIGraphX meets tolerance
:red_circle:bert_large_uncased_fp16: FAILED: MIGraphX is not within tolerance - check verbose output

     :white_check_mark: bert_large: PASSED: MIGraphX meets tolerance
     :white_check_mark: yolov5s: PASSED: MIGraphX meets tolerance
     :white_check_mark: tinyllama: PASSED: MIGraphX meets tolerance
     :white_check_mark: vicuna-fastchat: PASSED: MIGraphX meets tolerance
     :white_check_mark: whisper-tiny-encoder: PASSED: MIGraphX meets tolerance
     :white_check_mark: whisper-tiny-decoder: PASSED: MIGraphX meets tolerance
     :white_check_mark: distilgpt2_fp16: PASSED: MIGraphX meets tolerance

causten commented 1 week ago

Performance is all over the place. I can't merge this without some more feedback