migraphx-bot
commented
1 week ago | Test | Batch | Rate new 078757 |
Rate old 538898 |
Diff | Compare | |
|---|---|---|---|---|---|---|
| torchvision-resnet50 | 64 | 3,260.03 | 3,259.25 | 0.02% | :white_check_mark: | |
| torchvision-resnet50_fp16 | 64 | 6,978.06 | 6,987.98 | -0.14% | :white_check_mark: | |
| torchvision-densenet121 | 32 | 2,435.35 | 2,435.18 | 0.01% | :white_check_mark: | |
| torchvision-densenet121_fp16 | 32 | 4,073.17 | 4,107.65 | -0.84% | :white_check_mark: | |
| torchvision-inceptionv3 | 32 | 1,637.92 | 1,638.45 | -0.03% | :white_check_mark: | |
| torchvision-inceptionv3_fp16 | 32 | 2,764.77 | 2,765.03 | -0.01% | :white_check_mark: | |
| cadene-inceptionv4 | 16 | 776.82 | 776.04 | 0.10% | :white_check_mark: | |
| cadene-resnext64x4 | 16 | 811.14 | 811.47 | -0.04% | :white_check_mark: | |
| slim-mobilenet | 64 | 7,537.11 | 7,532.97 | 0.05% | :white_check_mark: | |
| slim-nasnetalarge | 64 | 211.55 | 211.47 | 0.04% | :white_check_mark: | |
| slim-resnet50v2 | 64 | 3,505.06 | 3,506.08 | -0.03% | :white_check_mark: | |
| bert-mrpc-onnx | 8 | 1,151.78 | 1,145.67 | 0.53% | :white_check_mark: | |
| bert-mrpc-tf | 1 | 461.35 | 464.12 | -0.60% | :white_check_mark: | |
| pytorch-examples-wlang-gru | 1 | 434.27 | 415.28 | 4.57% | :high_brightness: | |
| pytorch-examples-wlang-lstm | 1 | 387.14 | 382.85 | 1.12% | :white_check_mark: | |
| torchvision-resnet50_1 | 1 | 761.93 | 775.95 | -1.81% | :white_check_mark: | |
| cadene-dpn92_1 | 1 | 406.74 | 403.42 | 0.82% | :white_check_mark: | |
| cadene-resnext101_1 | 1 | 376.14 | 383.63 | -1.95% | :white_check_mark: | |
| onnx-taau-downsample | 1 | 342.37 | 341.73 | 0.19% | :white_check_mark: | |
| dlrm-criteoterabyte | 1 | 33.35 | 33.34 | 0.04% | :white_check_mark: | |
| dlrm-criteoterabyte_fp16 | 1 | 52.74 | 52.72 | 0.05% | :white_check_mark: | |
| agentmodel | 1 | 8,473.71 | 8,136.83 | 4.14% | :high_brightness: | |
| unet_fp16 | 2 | 58.96 | 58.73 | 0.39% | :white_check_mark: | |
| resnet50v1_fp16 | 1 | 1,001.92 | 968.97 | 3.40% | :high_brightness: | |
| resnet50v1_int8 | 1 | 988.66 | 1,017.05 | -2.79% | :white_check_mark: | |
| bert_base_cased_fp16 | 64 | 1,172.25 | 1,171.55 | 0.06% | :white_check_mark: | |
| bert_large_uncased_fp16 | 32 | 363.57 | 363.37 | 0.05% | :white_check_mark: | |
| bert_large_fp16 | 1 | 200.60 | 199.99 | 0.30% | :white_check_mark: | |
| distilgpt2_fp16 | 16 | 2,202.81 | 2,203.14 | -0.02% | :white_check_mark: | |
| yolov5s | 1 | 540.11 | 530.68 | 1.78% | :white_check_mark: | |
| tinyllama | 1 | 43.44 | 43.42 | 0.05% | :white_check_mark: | |
| vicuna-fastchat | 1 | 174.56 | 178.25 | -2.07% | :white_check_mark: | |
| whisper-tiny-encoder | 1 | 418.36 | 417.77 | 0.14% | :white_check_mark: | |
| whisper-tiny-decoder | 1 | 437.11 | 435.63 | 0.34% | :white_check_mark: |
Check results before merge :high_brightness:
Still testing, but the idea is to skip a passed test if the current commit hash matches is marked as passed already