ROCm / AMDMIGraphX

AMD's graph optimization engine.
https://rocm.docs.amd.com/projects/AMDMIGraphX/en/latest/
MIT License
185 stars 86 forks source link

Generic "truncate float" class for quantization #3604

Closed richagadgil closed 3 days ago

codecov[bot] commented 1 week ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 92.17%. Comparing base (2f97579) to head (52306f3). Report is 7 commits behind head on develop.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## develop #3604 +/- ## =========================================== - Coverage 92.18% 92.17% -0.01% =========================================== Files 513 513 Lines 21548 21560 +12 =========================================== + Hits 19863 19873 +10 - Misses 1685 1687 +2 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

migraphx-bot commented 1 week ago
Test Batch Rate new
9eb660
Rate old
4b96e1
Diff Compare
torchvision-resnet50 64 3,258.82 3,260.40 -0.05% :white_check_mark:
torchvision-resnet50_fp16 64 6,990.79 6,981.88 0.13% :white_check_mark:
torchvision-densenet121 32 2,435.52 2,436.50 -0.04% :white_check_mark:
torchvision-densenet121_fp16 32 4,079.37 4,081.96 -0.06% :white_check_mark:
torchvision-inceptionv3 32 1,638.67 1,638.04 0.04% :white_check_mark:
torchvision-inceptionv3_fp16 32 2,760.72 2,760.86 -0.01% :white_check_mark:
cadene-inceptionv4 16 776.57 776.56 0.00% :white_check_mark:
cadene-resnext64x4 16 807.69 811.67 -0.49% :white_check_mark:
slim-mobilenet 64 7,536.08 7,540.50 -0.06% :white_check_mark:
slim-nasnetalarge 64 211.47 211.49 -0.01% :white_check_mark:
slim-resnet50v2 64 3,503.45 3,506.73 -0.09% :white_check_mark:
bert-mrpc-onnx 8 1,146.66 1,147.08 -0.04% :white_check_mark:
bert-mrpc-tf 1 464.74 465.87 -0.24% :white_check_mark:
pytorch-examples-wlang-gru 1 423.38 423.73 -0.08% :white_check_mark:
pytorch-examples-wlang-lstm 1 405.37 389.07 4.19% :high_brightness:
torchvision-resnet50_1 1 776.93 788.22 -1.43% :white_check_mark:
cadene-dpn92_1 1 397.68 402.19 -1.12% :white_check_mark:
cadene-resnext101_1 1 383.08 382.83 0.06% :white_check_mark:
onnx-taau-downsample 1 343.31 343.07 0.07% :white_check_mark:
dlrm-criteoterabyte 1 33.34 33.34 -0.00% :white_check_mark:
dlrm-criteoterabyte_fp16 1 52.72 52.75 -0.06% :white_check_mark:
agentmodel 1 8,188.13 8,325.15 -1.65% :white_check_mark:
unet_fp16 2 58.90 58.80 0.18% :white_check_mark:
resnet50v1_fp16 1 933.56 953.06 -2.05% :white_check_mark:
resnet50v1_int8 1 1,020.03 1,005.99 1.40% :white_check_mark:
bert_base_cased_fp16 64 1,170.77 1,170.44 0.03% :white_check_mark:
bert_large_uncased_fp16 32 363.54 363.37 0.05% :white_check_mark:
bert_large_fp16 1 200.46 198.99 0.74% :white_check_mark:
distilgpt2_fp16 16 2,204.62 2,201.23 0.15% :white_check_mark:
yolov5s 1 537.68 536.00 0.31% :white_check_mark:
tinyllama 1 43.45 43.45 0.02% :white_check_mark:
vicuna-fastchat 1 171.01 174.10 -1.78% :white_check_mark:
whisper-tiny-encoder 1 418.45 418.74 -0.07% :white_check_mark:
whisper-tiny-decoder 1 428.69 425.97 0.64% :white_check_mark:

Check results before merge :high_brightness:

migraphx-bot commented 1 week ago


     :white_check_mark: bert-mrpc-onnx: PASSED: MIGraphX meets tolerance
     :white_check_mark: bert-mrpc-tf: PASSED: MIGraphX meets tolerance
     :white_check_mark: pytorch-examples-wlang-gru: PASSED: MIGraphX meets tolerance
     :white_check_mark: pytorch-examples-wlang-lstm: PASSED: MIGraphX meets tolerance
     :white_check_mark: torchvision-resnet50_1: PASSED: MIGraphX meets tolerance
     :white_check_mark: cadene-dpn92_1: PASSED: MIGraphX meets tolerance
     :white_check_mark: cadene-resnext101_1: PASSED: MIGraphX meets tolerance
     :white_check_mark: dlrm-criteoterabyte: PASSED: MIGraphX meets tolerance
     :white_check_mark: agentmodel: PASSED: MIGraphX meets tolerance
     :white_check_mark: unet: PASSED: MIGraphX meets tolerance
     :white_check_mark: resnet50v1: PASSED: MIGraphX meets tolerance
     :white_check_mark: bert_base_cased_fp16: PASSED: MIGraphX meets tolerance
:red_circle:bert_large_uncased_fp16: FAILED: MIGraphX is not within tolerance - check verbose output

     :white_check_mark: bert_large: PASSED: MIGraphX meets tolerance
     :white_check_mark: yolov5s: PASSED: MIGraphX meets tolerance
     :white_check_mark: tinyllama: PASSED: MIGraphX meets tolerance
     :white_check_mark: vicuna-fastchat: PASSED: MIGraphX meets tolerance
     :white_check_mark: whisper-tiny-encoder: PASSED: MIGraphX meets tolerance
     :white_check_mark: whisper-tiny-decoder: PASSED: MIGraphX meets tolerance
     :white_check_mark: distilgpt2_fp16: PASSED: MIGraphX meets tolerance