search

ROCm / AMDMIGraphX

AMD's graph optimization engine.
https://rocm.docs.amd.com/projects/AMDMIGraphX/en/latest/
MIT License
185 stars 86 forks source link

rocMLIR Weekly Sync 2024-10-27 #3560

Closed github-actions[bot] closed 1 week ago

github-actions[bot] commented 2 weeks ago

Update rocMLIR version

github-actions[bot] commented 2 weeks ago
model DEFAULT MLIR_EXTENDED
bert-mrpc-onnx :white_check_mark: :red_circle:
bert-mrpc-tf :white_check_mark: :white_check_mark:
pytorch-examples-wlang-gru :white_check_mark: :white_check_mark:
pytorch-examples-wlang-lstm :white_check_mark: :white_check_mark:
torchvision-resnet50_1 :white_check_mark: :white_check_mark:
cadene-dpn92_1 :white_check_mark: :white_check_mark:
cadene-resnext101_1 :white_check_mark: :white_check_mark:
dlrm-criteoterabyte :white_check_mark: :white_check_mark:
agentmodel :white_check_mark: :white_check_mark:
unet :white_check_mark: :red_circle:
resnet50v1 :white_check_mark: :white_check_mark:
bert_base_cased_fp16 :white_check_mark: :white_check_mark:
bert_large_uncased_fp16 :red_circle: :white_check_mark:
bert_large :white_check_mark: :white_check_mark:
yolov5s :white_check_mark: :white_check_mark:
tinyllama :white_check_mark: :white_check_mark:
vicuna-fastchat :white_check_mark: :white_check_mark:
whisper-tiny-encoder :white_check_mark: :red_circle:
whisper-tiny-decoder :white_check_mark: :white_check_mark:
distilgpt2_fp16 :white_check_mark: :white_check_mark:

:white_check_mark: - within tolerance :red_circle: - not within tolerance :x: - error in execution

migraphx-bot commented 2 weeks ago
Test Batch Rate new
0ae791		 Rate old
71fd27		 Diff Compare
torchvision-resnet50 64 3,258.64 3,258.47 0.01% :white_check_mark:
torchvision-resnet50_fp16 64 6,987.78 6,989.35 -0.02% :white_check_mark:
torchvision-densenet121 32 2,439.34 2,437.00 0.10% :white_check_mark:
torchvision-densenet121_fp16 32 4,083.09 4,070.38 0.31% :white_check_mark:
torchvision-inceptionv3 32 1,638.55 1,639.85 -0.08% :white_check_mark:
torchvision-inceptionv3_fp16 32 2,763.05 2,763.41 -0.01% :white_check_mark:
cadene-inceptionv4 16 775.94 776.50 -0.07% :white_check_mark:
cadene-resnext64x4 16 811.32 808.24 0.38% :white_check_mark:
slim-mobilenet 64 7,530.71 7,538.65 -0.11% :white_check_mark:
slim-nasnetalarge 64 211.48 211.54 -0.03% :white_check_mark:
slim-resnet50v2 64 3,505.27 3,507.21 -0.06% :white_check_mark:
bert-mrpc-onnx 8 1,147.37 1,150.51 -0.27% :white_check_mark:
bert-mrpc-tf 1 463.16 475.19 -2.53% :white_check_mark:
pytorch-examples-wlang-gru 1 512.98 426.61 20.25% :high_brightness:
pytorch-examples-wlang-lstm 1 398.24 376.26 5.84% :high_brightness:
torchvision-resnet50_1 1 784.25 785.19 -0.12% :white_check_mark:
cadene-dpn92_1 1 402.83 399.09 0.94% :white_check_mark:
cadene-resnext101_1 1 383.36 383.01 0.09% :white_check_mark:
onnx-taau-downsample 1 343.31 343.03 0.08% :white_check_mark:
dlrm-criteoterabyte 1 33.32 33.33 -0.01% :white_check_mark:
dlrm-criteoterabyte_fp16 1 52.73 52.73 0.01% :white_check_mark:
agentmodel 1 7,986.77 8,178.96 -2.35% :white_check_mark:
unet_fp16 2 59.06 58.92 0.24% :white_check_mark:
resnet50v1_fp16 1 937.24 925.30 1.29% :white_check_mark:
resnet50v1_int8 1 1,019.49 1,011.55 0.78% :white_check_mark:
bert_base_cased_fp16 64 1,171.99 1,169.93 0.18% :white_check_mark:
bert_large_uncased_fp16 32 363.42 363.31 0.03% :white_check_mark:
bert_large_fp16 1 200.13 200.50 -0.18% :white_check_mark:
distilgpt2_fp16 16 2,196.54 2,194.69 0.08% :white_check_mark:
yolov5s 1 538.30 533.06 0.98% :white_check_mark:
tinyllama 1 43.41 43.45 -0.09% :white_check_mark:
vicuna-fastchat 1 174.67 172.29 1.38% :white_check_mark:
whisper-tiny-encoder 1 418.52 417.95 0.14% :white_check_mark:
whisper-tiny-decoder 1 435.64 425.65 2.35% :white_check_mark:

Check results before merge :high_brightness:

migraphx-bot commented 2 weeks ago


     :white_check_mark: bert-mrpc-onnx: PASSED: MIGraphX meets tolerance
     :white_check_mark: bert-mrpc-tf: PASSED: MIGraphX meets tolerance
     :white_check_mark: pytorch-examples-wlang-gru: PASSED: MIGraphX meets tolerance
     :white_check_mark: pytorch-examples-wlang-lstm: PASSED: MIGraphX meets tolerance
     :white_check_mark: torchvision-resnet50_1: PASSED: MIGraphX meets tolerance
     :white_check_mark: cadene-dpn92_1: PASSED: MIGraphX meets tolerance
     :white_check_mark: cadene-resnext101_1: PASSED: MIGraphX meets tolerance
     :white_check_mark: dlrm-criteoterabyte: PASSED: MIGraphX meets tolerance
     :white_check_mark: agentmodel: PASSED: MIGraphX meets tolerance
     :white_check_mark: unet: PASSED: MIGraphX meets tolerance
     :white_check_mark: resnet50v1: PASSED: MIGraphX meets tolerance
     :white_check_mark: bert_base_cased_fp16: PASSED: MIGraphX meets tolerance
:red_circle:bert_large_uncased_fp16: FAILED: MIGraphX is not within tolerance - check verbose output

     :white_check_mark: bert_large: PASSED: MIGraphX meets tolerance
     :white_check_mark: yolov5s: PASSED: MIGraphX meets tolerance
     :white_check_mark: tinyllama: PASSED: MIGraphX meets tolerance
     :white_check_mark: vicuna-fastchat: PASSED: MIGraphX meets tolerance
     :white_check_mark: whisper-tiny-encoder: PASSED: MIGraphX meets tolerance
     :white_check_mark: whisper-tiny-decoder: PASSED: MIGraphX meets tolerance
     :white_check_mark: distilgpt2_fp16: PASSED: MIGraphX meets tolerance