search

Xilinx / llvm-aie

Fork of LLVM to support AMD AIEngine processors
Other
107 stars 12 forks source link

[AIEX] Ignore bank conflict if in the next cycle we cannot schedule the instruction. #229

Open krishnamtibrewala opened 2 weeks ago

krishnamtibrewala commented 2 weeks ago
Core_Compute_Cycle_Count CompareOps_K_EQ_GE_GT_LE_LT_CMP_GE_int8_aie2 Conv2D_DW_bf16_3 Conv2D_Transpose_AIE2_4 Conv2D_Transpose_AIE2_8 Conv2D_Transpose_bf16_AIE2_0 Conv2D_Transpose_bf16_AIE2_2 Conv2D_Transpose_bf16_AIE2_4 Conv2D_edge_mode_0 Conv2D_edge_mode_1 Conv2D_edge_mode_2 Exp_bf16_0 Exp_bf16_1 Exp_bf16_2 Exp_bf16_3 Exp_bf16_4 GEMM_bf16_5 GEMM_bf16_6 GEMM_bf16_8 GEMM_bf16_9 GEMM_bf16_10 GEMM_bf16_11 GroupConv2D_bf16_0 GroupConv2D_bf16_1 GroupConv2D_bf16_2 GroupConv2D_bf16_3 GroupConv2D_bf16_4 Group_Conv2D_0 Group_Conv2D_1 Group_Conv2D_2 Group_Conv2D_3 Group_Conv2D_4 Group_Conv2D_5 ReduceMeanAxis_1_aie2_bf16 ReduceMeanAxis_1_aie2_int8 ReduceMeanAxis_2_aie2_bf16 ReduceMeanAxis_2_aie2_int8 ReduceMeanAxis_3_aie2_bf16 ReduceMeanAxis_3_aie2_int8 ReduceMeanAxis_4_aie2_bf16 ReduceMeanAxis_4_aie2_int8 ReduceMeanAxis_5_aie2_bf16 ReduceMeanAxis_5_aie2_int8 ReduceMeanAxis_6_aie2_bf16 ReduceMeanAxis_6_aie2_int8 ReduceMeanAxis_7_aie2_bf16 ReduceMeanAxis_7_aie2_int8 ReduceMeanTemplated_AIE2_bfloat16 ReduceMeanTemplated_AIE2_int8 ReduceProdAxis_1_aie2_bf16 ReduceProdAxis_2_aie2_bf16 ReduceProdAxis_3_aie2_bf16 ReduceProdAxis_4_aie2_bf16 ReduceProdAxis_5_aie2_bf16 ReduceProdAxis_6_aie2_bf16 ReduceProdAxis_7_aie2_bf16 ReduceSumAxis_1_aie2_bf16 ReduceSumAxis_1_aie2_int8 ReduceSumAxis_2_aie2_bf16 ReduceSumAxis_2_aie2_int8 ReduceSumAxis_3_aie2_bf16 ReduceSumAxis_3_aie2_int8 ReduceSumAxis_4_aie2_bf16 ReduceSumAxis_4_aie2_int8 ReduceSumAxis_5_aie2_bf16 ReduceSumAxis_5_aie2_int8 ReduceSumAxis_6_aie2_bf16 ReduceSumAxis_6_aie2_int8 ReduceSumAxis_7_aie2_bf16 ReduceSumAxis_7_aie2_int8 ResizeBilinear_aie2_int8 ResizeNearest_aie2_int8 Softmax_bf16_0 Softmax_bf16_1 Softmax_bf16_2 Softmax_bf16_3 Softmax_bf16_4 bfloat16 Conv2D_bf16_1 Conv2D_bf16_4 Conv2D_bf16_7 Conv2D_bf16_42 Conv2D_bf16_44 Conv2D_bf16_0 Conv2D_bf16_3 Conv2D_bf16_43 Conv2D_bf16_41 Conv2D_bf16_6 Conv2D_bf16_58 GEMM_int8_0 Conv2D_bf16_57 Conv2D_mixed_batch_1 Select_aie2_int8 Conv2D_0 InstanceNormPart1_aie2_int8_0 Conv2D_LReLU_4 DilatedConv2D_2 DilatedConv2D_4 DilatedConv2D_3 DilatedConv2D_1 Conv2D_2x8_0 Ceil_AIE2_bfloat16 Conv2D_FC_8 GEMM_bf16_0 Conv2D_ReLU_5 Conv2D_ReLU_1 GEMM_bf16_3 Conv2D_FC_0 Conv2D_FC_4 GEMM_bf16_7 Conv2D_FC_3 GEMM_bf16_1 Conv2D_FC_5 Conv2D_ReLU_13 Conv2D_DW_1 Softmax_2 GEMM_bf16_2 LayerNormC8Part1_aie2_int8_0 Conv2D_ReLU_15 Conv2D_SV60 Conv2D_FC_1 GEMM_bf16_4 Conv2D_FC_7 Conv2D_ReLU_int8_1 MaxPool2D_11 MaxPool2D_15 Conv2D_ReLU_4 MaxPool2D_24 Elu_aie2_bf16_0 Conv2D_14 Conv2D_FC_2 Conv2D_ReLU_0 Conv2D_ReLU_Standalone_0 Conv2D_ReLU_Standalone_2 Conv2D_7x7s2_Layer1_1 MaxPool2D_2 MaxPool2D_3 MaxPool2D_6 MaxPool2D_7 Conv2D_ReLU_3 MaxPool2D_19 MaxPool2D_23 Conv2D_LReLU_7 Conv2D_12 Conv2D_bf16_2 Conv2D_bf16_5 Conv2D_bf16_8 Conv2D_FC_6 MaxPool2D_8 MaxPool2D_12 MaxPool2D_17 MaxPool2D_21 Conv2D_7x7s2_Layer1_2 MaxPool2D_1 MaxPool2D_5 MaxPool2D_10 MaxPool2D_14 Conv2D_ReLU_16 Conv2D_7 Conv2D_2 Conv2D_ReLU_Standalone_1 Conv2D_LReLU_0 GEMM_int8_1 GEMM_int8_3 Select_aie2_bf16 Conv2D_11x11s4_Layer1_1 Conv2D_8 MaxPool2D_0 MaxPool2D_4 Elu_aie2_int8_0 GEMM_int8_2 MaxPool2D_9 MaxPool2D_13 Softmax_1 Conv2D_DW_0 InstanceNormPart1_aie2_bf16_0 MaxPool2D_18 MaxPool2D_22 Conv2D_11 Conv2D_11x11s4_Layer1_2 Conv2D_11x11s4_Layer1_0 Mish_aie2_bfloat16 Slice_bfloat16_0 Conv2D_LReLU_6 Conv2D_ReLU_int8_2 Conv2D_ReLU_9 Conv2D_5 Conv2D_ReLU_11 AvgPool2D_7 Pad3D_AIE2_int8_2 Slice_int8_0 Conv1D_DW_AIE2_bf16_0 AvgPool2D_2 AvgPool2D_3 AvgPool2D_aie2_int8_2 AvgPool2D_aie2_int8_3 Conv1D_DW_AIE2_bf16_2 AvgPool2D_11 Conv2D_DW_bf16_0 Conv2D_LReLU_10 Conv1D_DW_AIE2_bf16_1 Conv2D_10 Conv2D_ReLU_10 AvgPool2D_4 AvgPool2D_9 Pad3D_AIE2_bfloat16_2 AvgPool2D_1 AvgPool2D_6 AvgPool2D_aie2_int8_1 Conv2D_LReLU_1 Conv2D_LReLU_9 Conv2D_9 Reciprocal_aie2_1 MaxPool2D_16 MaxPool2D_20 Conv2D_DW_bf16_2 AvgPool2D_0 AvgPool2D_aie2_int8_0 Conv1D_DW_AIE2_bf16_3 Conv2D_ReLU_8 Conv2D_LReLU_8 Rsqrt_aie2_int8_0 AvgPool2D_5 Range_bfloat16_aie2_1 Range_bfloat16_aie2_0 Conv2D_mixed_batch_0 AvgPool2D_10 Conv2D_ReLU_6 Conv2D_ReLU_int8_0 Conv2D_DW_bf16_1 Pad2D_bf16_0 ReduceSum_int8_0 Pad3D_AIE2_bfloat16 Pad3D_AIE2_int8 LayerNormC8Part2_aie2_bf16_0 AvgPool2D_8 Conv2D_3 PixelUnshuffle_int8_0 PixelUnshuffle_bf16_0 Conv2D_6 Conv1D_DW_AIE2_int8_1 Conv1D_DW_AIE2_int8_2 Conv1D_DW_AIE2_int8_0 Pow_bf16_0 Pow_bf16_2 Pow_bf16_1 Pow_bf16_3 Abs_bf16_0 Abs_int8_0 Add2D_0 Add2D_1 Add2D_2 Add2D_Standalone_0 Add2D_Standalone_1 Add2D_Standalone_2 Add2D_Standalone_3 Add2D_Standalone_4 Add2D_Standalone_5 Add2D_Standalone_6 Add2D_Standalone_7 Add2D_Standalone_8 Add2D_bf16_0 Add2D_bf16_1 AddAttributeBroadcasting_aie2_bf16 AddAttributeBroadcasting_aie2_int8 AddBf16_aie2_0 AddBroadcastingBf16_aie2_0 AddBroadcasting_aie2_0 Add_aie2_0 BatchNorm1d_aie2_bfloat16 BatchNorm2D_1 BitShift_AIE2_int8 BitwiseAnd_int8_0 BitwiseNot_aie2_0 BitwiseOr_int8_0 BitwiseXor_aie2_int8 Cast_aie2_bfloat16 Cast_aie2_bfloat16_1 Cast_aie2_bfloat16_2 Cast_aie2_int8 Cast_aie2_int8_1 Cast_aie2_int8_2 Ceil_AIE2_int8 ChannelsFirstFlatten_bf16_0 ChannelsFirstFlatten_int8_0 Clip_aie2_bf16 Clip_aie2_int8 CompareOpsAttributeBroadcasting_aie2_bf16 CompareOpsAttributeBroadcasting_aie2_int8 CompareOpsBroadcasting_K_EQ_GE_GT_LE_LT_CMP_GE_bfloat16_aie2 CompareOpsBroadcasting_K_EQ_GE_GT_LE_LT_CMP_GE_int8_aie2 CompareOps_K_EQ_GE_GT_LE_LT_CMP_EQ_bfloat16_aie2 CompareOps_K_EQ_GE_GT_LE_LT_CMP_EQ_int8_aie2 CompareOps_K_EQ_GE_GT_LE_LT_CMP_GE_bfloat16_aie2 CompareOps_K_EQ_GE_GT_LE_LT_CMP_GE_int8_aie2_ptr_interface CompareOps_K_EQ_GE_GT_LE_LT_CMP_GT_int32_aie2 Conv2D_2x8_1 Conv2D_4 Conv2D_13 Conv2D_ReLU_2 Conv2D_ReLU_12 Conv2D_ReLU_14 DegroupG4_aie2_bf16_0 DegroupG4_aie2_bf16_1 DegroupG4_aie2_bf16_2 DegroupG4_aie2_int8_0 DegroupG4_aie2_int8_1 DegroupG4_aie2_int8_2 DegroupG8_aie2_bf16_0 DegroupG8_aie2_bf16_1 DegroupG8_aie2_bf16_2 DegroupG8_aie2_int8_0 DegroupG8_aie2_int8_1 DegroupG8_aie2_int8_2 DivAttributeBroadcasting_aie2_bf16_0 DivAttributeBroadcasting_aie2_int8_0 DivBroadcasting_aie2_0 DivBroadcasting_aie2_1 EleMax_aie2_bfloat16 EleMax_aie2_int8 EleMin_aie2_bfloat16 EleMin_aie2_int8 ElemDiv_aie2_0 ElemDiv_aie2_1 Erf_aie2_bf16_0 Erf_aie2_int8_0 Erf_aie2_int8_0_ptr_interface Expand_aie2_bfloat16 Expand_aie2_int8 Floor_aie2_0 Floor_aie2_1 FullyConnect_aie2_bf16 FullyConnect_aie2_int8 GELU_0 GELU_1 GELU_2 GELU_3 GEMV_0 GEMV_1 GeluTemplated_aie2_bf16 GeluTemplated_aie2_int8 GroupG4_aie2_bf16_0 GroupG4_aie2_bf16_1 GroupG4_aie2_bf16_2 GroupG4_aie2_int8_0 GroupG4_aie2_int8_1 GroupG4_aie2_int8_2 GroupG8_aie2_bf16_1 GroupG8_aie2_bf16_2 GroupG8_aie2_int8_1 GroupG8_aie2_int8_2 HardSigmoidTemplated_bf16_0 HardSigmoidTemplated_int8_0 HardSigmoid_bf16_0 HardSigmoid_bf16_1 HardSigmoid_bf16_2 HardSigmoid_bf16_3 HardSigmoid_int8_0 HardSigmoid_int8_1 HardSigmoid_int8_2 HardSigmoid_int8_3 HardswishAsHardsigmoid_aie2_0 HardswishAsHardsigmoid_aie2_1 Hardswish_aie2_0 Hardswish_aie2_1 InstanceNormPart2_aie2_bf16_0 InstanceNormPart2_aie2_int8_0 InterpolateLinear1D_AIE2_bfloat16 InterpolateLinear1D_AIE2_int8 LayerNorm_0 LayerNorm_1 LayerNorm_2 Log_bf16_0 Log_int8_0 LogicalNot_aie2_0 LogicalXor_aie2_int8 MaxPool2D_bf16_0 MaxPool2D_bf16_1 MaxPool2D_bf16_2 MaxPool2D_bf16_3 Mish_aie2_int8 Mod_aie2_bf16 Mul2D_0 Mul2D_1 Mul2D_2 Mul2D_3 MulAttributeBroadcasting_aie2_int8_0 MulBroadcasting_aie2_0 Mul_aie2_0 Neg_aie2_0 Neg_aie2_1 Pad2D_0 Pad2D_1 Pad2D_2 Pad2D_3 Pad2D_4 Pad2D_5 Pad2D_6 Pad2D_7 Pad2D_8 Pad2D_9 Pad2D_10 Pad2D_11 Pad2D_12 Pad2D_13 Pad2D_14 Pad2D_15 PixelShuffle_aie2_bf16 PixelShuffle_aie2_int8 PowAttributeBroadcasting_aie2_bf16_0 PowAttributeBroadcasting_aie2_int8_0 Pow_int8_0 Reciprocal_aie2_0 ReduceMax_bf16_0 ReduceMax_bf16_1 ReduceMax_int8_0 ReduceMax_int8_1 ReduceMin1D_aie2_bf16 ReduceMin1D_aie2_int8 ReduceMin_bf16_0 ReduceMin_bf16_1 ReduceMin_int8_0 ReduceMin_int8_1 Requantize_0 Requantize_1 Rescale_aie2_int8_0 Round_aie2_0 Round_aie2_1 Rsqrt_aie2_bf16_0 Scale_Add_0 Scale_Add_1 Scale_Add_bf16_0 Scale_Add_bf16_1 Shrink_aie2_0 Shrink_aie2_1 SiLU_aie2_bf16 SiLU_aie2_int8 SiLU_aie2_int8_1 SiLU_aie2_int8_2 SiLU_aie2_int8_3 SigmoidTemplated_bf16_0 SigmoidTemplated_int8_0 SigmoidTemplated_int8_1 SigmoidTemplated_int8_2 Sigmoid_bf16_0 Sigmoid_bf16_1 Sigmoid_bf16_2 Sigmoid_bf16_3 Sigmoid_int8_0 Sigmoid_int8_1 Sigmoid_int8_2 Sign_bf16_0 Sign_bf16_1 Sign_int8_0 Sign_int8_1 Sin_aie2_bf16 Sin_aie2_int8 Softmax_3 Softmax_4 Sqrt_bf16_0 Sqrt_bf16_1 Sqrt_int8_0 Sqrt_int8_1 Squeeze_bfloat16_0 Squeeze_int8_0 SubAttributeBroadcasting_aie2_bf16_0 SubAttributeBroadcasting_aie2_int8_0 SubBroadcasting_aie2_bf16_0 SubBroadcasting_aie2_int8_0 SubBroadcasting_aie2_int8_0_ptr_interface Sub_aie2_bf16_0 Sub_aie2_int8_0 Sub_aie2_int8_0_ptr_interface TanhTemplated_aie2_bfloat16 TanhTemplated_aie2_int8 Tanh_0 Tanh_1 Tanh_2 Tanh_3 Tanh_int8_0 Tanh_int8_1 Tanh_int8_2 Tanh_int8_3 ThresholdedRelu_aie2_bfloat16 ThresholdedRelu_aie2_int8 Tile_aie2_bf16_0 Tile_aie2_int8_1 Topk1D_bf16_0 Topk1D_bf16_1 Topk1D_bf16_2 Topk1D_int8_0 Topk1D_int8_1 Topk1D_int8_2 Topk2D_bf16_0 Topk2D_bf16_1 Topk2D_bf16_2 Topk2D_int8_0 Topk2D_int8_1 Topk2D_int8_2 Transpose_aie2_bf16_021 Transpose_aie2_bf16_021_pad Transpose_aie2_bf16_102 Transpose_aie2_bf16_102_pad Transpose_aie2_bf16_120 Transpose_aie2_bf16_120_pad Transpose_aie2_bf16_201 Transpose_aie2_bf16_201_pad Transpose_aie2_bf16_210 Transpose_aie2_bf16_210_pad Transpose_aie2_int8_021 Transpose_aie2_int8_021_pad Transpose_aie2_int8_102 Transpose_aie2_int8_102_pad Transpose_aie2_int8_120 Transpose_aie2_int8_120_pad Transpose_aie2_int8_201 Transpose_aie2_int8_201_pad Transpose_aie2_int8_210 Transpose_aie2_int8_210_pad int8 Conv2D_ReLU_7 ReduceSum_bf16_0 ReduceSum_bf16_1 AvgPool2dVariant_aie2_bf16_15 Conv2D_11x11s4_0 ReduceSum_int8_1 AvgPool2dVariant_aie2_bf16_5 AvgPool2dVariant_aie2_int8_8 Conv2D_1 AvgPool2dVariant_aie2_int8_14 Conv2D_LReLU_11 Range_int8_aie2_1 AvgPool2dVariant_aie2_int8_15 AvgPool2dVariant_aie2_bf16_12 AvgPool2dVariant_aie2_bf16_0 AvgPool2dVariant_aie2_int8_4 Conv2D_11x11s4_1 AvgPool2dVariant_aie2_bf16_2 AvgPool2dVariant_aie2_bf16_11 Range_int8_aie2_0 AvgPool2dVariant_aie2_bf16_10 AvgPool2dVariant_aie2_int8_9 AvgPool2dVariant_aie2_int8_7 AvgPool2D_aie2_bfloat16_0 AvgPool2dVariant_aie2_int8_13 AvgPool2dVariant_aie2_bf16_14 AvgPool2dVariant_aie2_int8_1 Conv2D_7x7s2_Layer1_0 Conv2D_LReLU_2 AvgPool2dVariant_aie2_bf16_8 AvgPool2dVariant_aie2_bf16_13 Conv2D_ReLU_17 AvgPool2dVariant_aie2_int8_2 LayerNormC8Part1_aie2_bf16_0 AvgPool2dVariant_aie2_int8_5 AvgPool2dVariant_aie2_bf16_7 AvgPool2dVariant_aie2_int8_11 AvgPool2dVariant_aie2_int8_6 AvgPool2dVariant_aie2_int8_12 AvgPool2dVariant_aie2_bf16_9 AvgPool2D_aie2_bfloat16_1 AvgPool2dVariant_aie2_bf16_6 AvgPool2dVariant_aie2_int8_10 AvgPool2dVariant_aie2_int8_0 Add2D_3 GroupG8_aie2_int8_0 AvgPool2dVariant_aie2_int8_3 AvgPool2dVariant_aie2_bf16_1 Add2D_Standalone_10 AvgPool2D_aie2_bfloat16_2 AvgPool2D_aie2_bfloat16_3 AvgPool2dVariant_aie2_bf16_4 AvgPool2dVariant_aie2_bf16_16 AvgPool2dVariant_aie2_bf16_3 Conv2D_LReLU_5 AvgPool2dVariant_aie2_int8_16 Add2D_Standalone_11 GroupG8_aie2_bf16_0 Add2D_Standalone_9 Conv2D_LReLU_3 Tile_aie2_int8_3 Add2D_bf16_3 Conv2D_DW_3 Tile_aie2_bf16_2 Conv2D_DW_5 Add2D_bf16_2 Conv2D_DW_2 Mul2d_bf16_1 Conv2D_DW_4 BilinearInterpolation_1 LayerNormC8Part2_aie2_int8_0 MulAttributeBroadcasting_aie2_bf16_0 Conv2D_bf16_59 MulBroadcastingBf16_aie2_0 MulBf16_aie2_0 Conv2D_Transpose_AIE2_6 Mul2d_bf16_0 Conv2D_Transpose_AIE2_2 Conv2D_Transpose_AIE2_3 Conv2D_Transpose_bf16_AIE2_1 BilinearInterpolation_0 Conv2D_Transpose_AIE2_7 Conv2D_Transpose_AIE2_0 Conv2D_Transpose_AIE2_1 BilinearInterpolation_2 BilinearInterpolation_3 BilinearInterpolation_4 Conv2D_Transpose_AIE2_5 Conv2D_Transpose_bf16_AIE2_3 BatchNorm1d_aie2_int8 BatchNorm2D_0 Averege diff Diff stdev Quantile #1 Quantile #2 Quantile #3 Quantile #4 Quantile #5 Quantile #6 Quantile #7 Quantile #8 Quantile #9
Baseline 1088 44265 1327 38220 38220 38306 10366 45743 23279 23279 17663 12047 24804 7340 2907 10574 21630 316 7805 11497 8719 10462 20570 10571 5503 1929 1523 7100 3732 27636 27621 2104 2760 2438 4349 1995 7779 1781 933 955 3126 11275 7944 1079 968 1254 1524 1271 1037 383 383 1387 435 2715 1360 1264 1386 1386 1195 1723 493 493 493 493 1493 499 499 17469 1573 19084 19084 20608 1760 603 603 603 603 1711 695 695 695 695 1936 2481 2171 2643 2285 33041 33041 439 3089 2239 903 903 689 33041 1019 1019 536 3019 3029 1123 1123 1481 3060 4385 5451 1055 4914 4613 2171 3941 4439 458 979 1655 3468 608 608 608 608 7914 614 1307 2664 4012 7135 7135 758 758 1775 890 890 890 5373 10147 14934 2217 4659 4659 2339 1178 1178 14146 13166 14931 2490 1334 2669 4065 11206 1478 1528 10272 4289 2504 19780 9208 9595 11388 6374 6942 14681 17257 10161 22178 33325 33327 34190 34190 34196 34196 485 620 327 545 490 432 592 1414 1508 386 2274 595 907 2057 364 408 870 917 782 836 886 836 69201 69201 2118 577 245 577 731 1084 1084 1084 963 963 963 495 13714 12042 319 355 1609 1295 1565 1070 1572 1077 1584 1088 1208 3932 6227 736 1531 960 707 713 1100 526 474 668 383 857 1259 527 546 747 383 5482 7912 2169 1560 337 274 337 274 2111 1498 2880 2664 2643 2070 2017 439 991 1200 939 2254 2920 1587 5254 579 497 1389 1214 605 1642 519 422 938 376 1769 520 1001 376 665 366 1047 759 503 1015 527 537 367 447 1480 1634 1480 1629 9646 11618 14598 12098 19243 16305 4754 4259 1727 314 638 1907 1379 851 851 9495 5359 643 643 427 746 627 404 341 889 565 737 1853 1084 180 271 717 271 717 674 2126 1184 208 330 813 406 1544 8680 7390 40573 4422 4312 1441 7303 9543 14619 19425 298 274 7303 18579 8907 19179 1531 891 342 477 1321 3715 424 424 1380 1380 767 869 3018 3079 3077 3079 3079 1743 1387 1387 1387 2737 1837 1037 2637 34954 34954 34954 1188 320 512 232 3125 959 7435 14737 29888 3904 19274 19274 300 300 870 917 814 864 864 760 814 814 1160 409 2080 2688 1472 4816 448 516 380 754 653 977 4374 2705 1217 169 975 836 118 836 34469 303 21925 30723 252 17635 1966 2448 1265 1250 1966 1862 1981 1877 1978 1978 2795 3722 1259 1199 2796 2796 2810 2654 2804 2648 959 6951 12319 12319 5928 5895 11510 2712 5201 2560 4867 9718 1846 6981 3477 3035 7068 5530 3889 3685 1219 3430 5708 4555 3357 4329 4155 4074 5996 10426 3768 3705 924 3645 9092 4530 2475 4083 4081 4057 3169 2357 3050 3795 2911 709 653 2036 1891 455 1363 1363 1429 1238 901 3295 1191 2945 1108 1872 1241 2746 378 1711 4462 2220 432 6386 437 4019 471 11332 1003 6216 857 802 2908 629 5479 23333 6402 777 13276 53955 14551 993 993 993 18424 45652 34549 34781
----------------------------------------------------------------- ---------------------------------------------- ------------------ ------------------------- ------------------------- ------------------------------ ------------------------------ ------------------------------ -------------------- -------------------- -------------------- ------------ ------------ ------------ ------------ ------------ ------------- ------------- ------------- ------------- -------------- -------------- -------------------- -------------------- -------------------- -------------------- -------------------- ---------------- ---------------- ---------------- ---------------- ---------------- ---------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ----------------------------------- ------------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- --------------------------- --------------------------- --------------------------- --------------------------- --------------------------- --------------------------- --------------------------- --------------------------- --------------------------- --------------------------- --------------------------- --------------------------- --------------------------- --------------------------- -------------------------- ------------------------- ---------------- ---------------- ---------------- ---------------- ---------------- -------------- --------------- --------------- --------------- ---------------- ---------------- --------------- --------------- ---------------- ---------------- --------------- ---------------- -------------- ---------------- ---------------------- ------------------ -------------- ------------------------------- ---------------- ----------------- ----------------- ----------------- ----------------- -------------- -------------------- -------------- -------------- --------------- --------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- ---------------- -------------- -------------- -------------- ------------------------------ ---------------- -------------- -------------- -------------- -------------- -------------------- -------------- -------------- --------------- -------------- ----------------- -------------- -------------- --------------- -------------------------- -------------------------- ----------------------- -------------- -------------- -------------- -------------- --------------- -------------- -------------- ---------------- -------------- --------------- --------------- --------------- -------------- -------------- -------------- -------------- -------------- ----------------------- -------------- -------------- -------------- -------------- ---------------- -------------- -------------- -------------------------- ---------------- -------------- -------------- ------------------ ------------------------- -------------- -------------- -------------- ----------------- -------------- -------------- -------------- -------------- -------------- ------------------------------- -------------- -------------- -------------- ------------------------- ------------------------- -------------------- ------------------ ---------------- -------------------- --------------- -------------- ---------------- -------------- ------------------- -------------- ----------------------- -------------- -------------- ----------------------- ----------------------- ----------------------- -------------- ------------------ ----------------- ----------------------- -------------- ---------------- -------------- -------------- ----------------------- -------------- -------------- ----------------------- ---------------- ---------------- -------------- ------------------- -------------- -------------- ------------------ -------------- ----------------------- ----------------------- --------------- ---------------- ------------------- -------------- ----------------------- ----------------------- ---------------------- -------------- --------------- -------------------- ------------------ -------------- ------------------ --------------------- ----------------- ------------------------------ -------------- -------------- ----------------------- ----------------------- -------------- ----------------------- ----------------------- ----------------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------------- -------------------- -------------------- -------------------- -------------------- -------------------- -------------------- -------------------- -------------------- -------------- -------------- ------------------------------------ ------------------------------------ ---------------- ---------------------------- ------------------------ -------------- --------------------------- --------------- -------------------- ------------------- ------------------- ------------------ ---------------------- -------------------- ---------------------- ---------------------- ---------------- ------------------ ------------------ ---------------- ----------------------------- ----------------------------- ---------------- ---------------- ------------------------------------------- ------------------------------------------- -------------------------------------------------------------- ---------------------------------------------------------- -------------------------------------------------- ---------------------------------------------- -------------------------------------------------- ------------------------------------------------------------ ----------------------------------------------- -------------- -------------- -------------- --------------- ---------------- ---------------- ----------------------- ----------------------- ----------------------- ----------------------- ----------------------- ----------------------- ----------------------- ----------------------- ----------------------- ----------------------- ----------------------- ----------------------- -------------------------------------- -------------------------------------- ------------------------ ------------------------ ---------------------- ------------------ ---------------------- ------------------ ---------------- ---------------- ----------------- ----------------- ------------------------------- ---------------------- ------------------ -------------- -------------- ------------------------ ------------------------ -------------- -------------- -------------- -------------- -------------- -------------- ------------------------- ------------------------- --------------------- --------------------- --------------------- --------------------- --------------------- --------------------- --------------------- --------------------- --------------------- --------------------- ----------------------------- ----------------------------- -------------------- -------------------- -------------------- -------------------- -------------------- -------------------- -------------------- -------------------- ------------------------------- ------------------------------- ------------------ ------------------ ------------------------------- ------------------------------- ----------------------------------- ------------------------------- -------------- -------------- -------------- -------------- -------------- ------------------- ---------------------- ------------------ ------------------ ------------------ ------------------ ---------------- --------------- -------------- -------------- -------------- -------------- -------------------------------------- ------------------------ -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- ------------------------ ------------------------ -------------------------------------- -------------------------------------- -------------- ------------------- ------------------ ------------------ ------------------ ------------------ ----------------------- ----------------------- ------------------ ------------------ ------------------ ------------------ -------------- -------------- --------------------- -------------- -------------- ------------------- -------------- -------------- ------------------ ------------------ --------------- --------------- ---------------- ---------------- ------------------ ------------------ ------------------ ------------------------- ------------------------- ------------------------- ------------------------- ---------------- ---------------- ---------------- ---------------- ---------------- ---------------- ---------------- -------------- -------------- -------------- -------------- --------------- --------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------------- ---------------- -------------------------------------- -------------------------------------- ----------------------------- ----------------------------- ------------------------------------------- ----------------- ----------------- ------------------------------- ----------------------------- ------------------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- ------------------------------- --------------------------- ------------------ ------------------ --------------- --------------- --------------- --------------- --------------- --------------- --------------- --------------- --------------- --------------- --------------- --------------- ------------------------- ----------------------------- ------------------------- ----------------------------- ------------------------- ----------------------------- ------------------------- ----------------------------- ------------------------- ----------------------------- ------------------------- ----------------------------- ------------------------- ----------------------------- ------------------------- ----------------------------- ------------------------- ----------------------------- ------------------------- ----------------------------- -------------- --------------- ------------------ ------------------ ------------------------------- ------------------ ------------------ ------------------------------ ------------------------------ -------------- ------------------------------- ----------------- ------------------- ------------------------------- ------------------------------- ------------------------------ ------------------------------ ------------------ ------------------------------ ------------------------------- ------------------- ------------------------------- ------------------------------ ------------------------------ --------------------------- ------------------------------- ------------------------------- ------------------------------ ----------------------- ---------------- ------------------------------ ------------------------------- ---------------- ------------------------------ ------------------------------ ------------------------------ ------------------------------ ------------------------------- ------------------------------ ------------------------------- ------------------------------ --------------------------- ------------------------------ ------------------------------- ------------------------------ -------------- --------------------- ------------------------------ ------------------------------ --------------------- --------------------------- --------------------------- ------------------------------ ------------------------------- ------------------------------ ---------------- ------------------------------- --------------------- --------------------- -------------------- ---------------- ------------------ -------------- -------------- ------------------ -------------- -------------- -------------- -------------- -------------- ------------------------- ------------------------------ -------------------------------------- ---------------- ---------------------------- ---------------- ------------------------- -------------- ------------------------- ------------------------- ------------------------------ ------------------------- ------------------------- ------------------------- ------------------------- ------------------------- ------------------------- ------------------------- ------------------------- ------------------------------ ----------------------- --------------- -------------- ------------ ------------- ------------- ------------- ------------- ------------- ------------- ------------- ------------- -------------
With Changes 45488 1450 41468 41468 41557 11182 48193 24513 24513 18596 12669 26034 7693 3045 11072 22597 330 8128 11943 9042 10781 21196 10876 5657 1981 1555 7241 3806 28156 28140 2143 2811 2483 4425 2029 7911 1810 948 970 3174 11447 8060 1093 980 1269 1541 1285 1048 387 387 1401 439 2739 1372 1275 1398 1398 1205 1737 497 497 497 497 1505 503 503 17608 1585 19223 19223 20752 1772 607 607 607 607 1721 699 699 699 699 1947 2495 2183 2657 2296 33196 33196 441 3103 2249 907 907 692 33174 1023 1023 538 3030 3040 1127 1127 1486 3070 4398 5467 1058 4927 4624 2176 3950 4449 459 981 1658 3474 609 609 609 609 7927 615 1309 2668 4018 7145 7145 759 759 1777 891 891 891 5379 10158 14949 2219 4663 4663 2341 1179 1179 14158 13177 14943 2492 1335 2671 4068 11214 1479 1529 10278 4291 2505 19787 9210 9597 11390 6375 6943 14683 17259 10162 22180 33327 33329 34192 34192 34198 34198 485 620 327 545 490 432 592 1414 1508 386 2274 595 907 2057 364 408 870 917 782 836 886 836 69201 69201 2118 577 245 577 731 1084 1084 1084 963 963 963 495 13714 12042 319 355 1609 1295 1565 1070 1572 1077 1584 1088 1208 3932 6227 736 1531 960 707 713 1100 526 474 668 383 857 1259 527 546 747 383 5482 7912 2169 1560 337 274 337 274 2111 1498 2880 2664 2643 2070 2017 439 991 1200 939 2254 2920 1587 5254 579 497 1389 1214 605 1642 519 422 938 376 1769 520 1001 376 665 366 1047 759 503 1015 527 537 367 447 1480 1634 1480 1629 9646 11618 14598 12098 19243 16305 4754 4259 1727 314 638 1907 1379 851 851 9495 5359 643 643 427 746 627 404 341 889 565 737 1853 1084 180 271 717 271 717 674 2126 1184 208 330 813 406 1544 8680 7390 40573 4422 4312 1441 7303 9543 14619 19425 298 274 7303 18579 8907 19179 1531 891 342 477 1321 3715 424 424 1380 1380 767 869 3018 3079 3077 3079 3079 1743 1387 1387 1387 2737 1837 1037 2637 34954 34954 34954 1188 320 512 232 3125 959 7435 14737 29888 3904 19274 19274 300 300 870 917 814 864 864 760 814 814 1160 409 2080 2688 1472 4816 448 516 380 754 653 977 4374 2705 1217 169 975 836 118 836 34469 303 21925 30723 252 17635 1966 2448 1265 1250 1966 1862 1981 1877 1978 1978 2795 3722 1259 1199 2796 2796 2810 2654 2804 2648 959 6950 12315 12315 5926 5893 11506 2711 5199 2559 4865 9713 1845 6977 3475 3033 7063 5526 3886 3682 1218 3427 5703 4551 3354 4325 4151 4070 5990 10415 3764 3701 923 3641 9082 4525 2472 4078 4076 4052 3165 2354 3046 3790 2907 708 652 2032 1887 454 1360 1360 1425 1234 898 3284 1187 2935 1104 1863 1230 2714 373 1688 4398 2174 423 6234 426 3912 458 10996 972 6008 827 772 2784 602 5192 22102 6063 734 12524 50780 13687 926 926 926 16940 41752 31070 31262 +0.10% 1.75 -0.12% +0.00% +0.00% +0.00% +0.00% +0.00% +0.01% +0.26% +0.88%
----------------------------------------------------------------- ---------------------------------------------- ------------------ ------------------------- ------------------------- ------------------------------ ------------------------------ ------------------------------ -------------------- -------------------- -------------------- ------------ ------------ ------------ ------------ ------------ ------------- ------------- ------------- ------------- -------------- -------------- -------------------- -------------------- -------------------- -------------------- -------------------- ---------------- ---------------- ---------------- ---------------- ---------------- ---------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ----------------------------------- ------------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- --------------------------- --------------------------- --------------------------- --------------------------- --------------------------- --------------------------- --------------------------- --------------------------- --------------------------- --------------------------- --------------------------- --------------------------- --------------------------- --------------------------- -------------------------- ------------------------- ---------------- ---------------- ---------------- ---------------- ---------------- -------------- --------------- --------------- --------------- ---------------- ---------------- --------------- --------------- ---------------- ---------------- --------------- ---------------- -------------- ---------------- ---------------------- ------------------ -------------- ------------------------------- ---------------- ----------------- ----------------- ----------------- ----------------- -------------- -------------------- -------------- -------------- --------------- --------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- ---------------- -------------- -------------- -------------- ------------------------------ ---------------- -------------- -------------- -------------- -------------- -------------------- -------------- -------------- --------------- -------------- ----------------- -------------- -------------- --------------- -------------------------- -------------------------- ----------------------- -------------- -------------- -------------- -------------- --------------- -------------- -------------- ---------------- -------------- --------------- --------------- --------------- -------------- -------------- -------------- -------------- -------------- ----------------------- -------------- -------------- -------------- -------------- ---------------- -------------- -------------- -------------------------- ---------------- -------------- -------------- ------------------ ------------------------- -------------- -------------- -------------- ----------------- -------------- -------------- -------------- -------------- -------------- ------------------------------- -------------- -------------- -------------- ------------------------- ------------------------- -------------------- ------------------ ---------------- -------------------- --------------- -------------- ---------------- -------------- ------------------- -------------- ----------------------- -------------- -------------- ----------------------- ----------------------- ----------------------- -------------- ------------------ ----------------- ----------------------- -------------- ---------------- -------------- -------------- ----------------------- -------------- -------------- ----------------------- ---------------- ---------------- -------------- ------------------- -------------- -------------- ------------------ -------------- ----------------------- ----------------------- --------------- ---------------- ------------------- -------------- ----------------------- ----------------------- ---------------------- -------------- --------------- -------------------- ------------------ -------------- ------------------ --------------------- ----------------- ------------------------------ -------------- -------------- ----------------------- ----------------------- -------------- ----------------------- ----------------------- ----------------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------------- -------------------- -------------------- -------------------- -------------------- -------------------- -------------------- -------------------- -------------------- -------------- -------------- ------------------------------------ ------------------------------------ ---------------- ---------------------------- ------------------------ -------------- --------------------------- --------------- -------------------- ------------------- ------------------- ------------------ ---------------------- -------------------- ---------------------- ---------------------- ---------------- ------------------ ------------------ ---------------- ----------------------------- ----------------------------- ---------------- ---------------- ------------------------------------------- ------------------------------------------- -------------------------------------------------------------- ---------------------------------------------------------- -------------------------------------------------- ---------------------------------------------- -------------------------------------------------- ------------------------------------------------------------ ----------------------------------------------- -------------- -------------- -------------- --------------- ---------------- ---------------- ----------------------- ----------------------- ----------------------- ----------------------- ----------------------- ----------------------- ----------------------- ----------------------- ----------------------- ----------------------- ----------------------- ----------------------- -------------------------------------- -------------------------------------- ------------------------ ------------------------ ---------------------- ------------------ ---------------------- ------------------ ---------------- ---------------- ----------------- ----------------- ------------------------------- ---------------------- ------------------ -------------- -------------- ------------------------ ------------------------ -------------- -------------- -------------- -------------- -------------- -------------- ------------------------- ------------------------- --------------------- --------------------- --------------------- --------------------- --------------------- --------------------- --------------------- --------------------- --------------------- --------------------- ----------------------------- ----------------------------- -------------------- -------------------- -------------------- -------------------- -------------------- -------------------- -------------------- -------------------- ------------------------------- ------------------------------- ------------------ ------------------ ------------------------------- ------------------------------- ----------------------------------- ------------------------------- -------------- -------------- -------------- -------------- -------------- ------------------- ---------------------- ------------------ ------------------ ------------------ ------------------ ---------------- --------------- -------------- -------------- -------------- -------------- -------------------------------------- ------------------------ -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- ------------------------ ------------------------ -------------------------------------- -------------------------------------- -------------- ------------------- ------------------ ------------------ ------------------ ------------------ ----------------------- ----------------------- ------------------ ------------------ ------------------ ------------------ -------------- -------------- --------------------- -------------- -------------- ------------------- -------------- -------------- ------------------ ------------------ --------------- --------------- ---------------- ---------------- ------------------ ------------------ ------------------ ------------------------- ------------------------- ------------------------- ------------------------- ---------------- ---------------- ---------------- ---------------- ---------------- ---------------- ---------------- -------------- -------------- -------------- -------------- --------------- --------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------------- ---------------- -------------------------------------- -------------------------------------- ----------------------------- ----------------------------- ------------------------------------------- ----------------- ----------------- ------------------------------- ----------------------------- ------------------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- ------------------------------- --------------------------- ------------------ ------------------ --------------- --------------- --------------- --------------- --------------- --------------- --------------- --------------- --------------- --------------- --------------- --------------- ------------------------- ----------------------------- ------------------------- ----------------------------- ------------------------- ----------------------------- ------------------------- ----------------------------- ------------------------- ----------------------------- ------------------------- ----------------------------- ------------------------- ----------------------------- ------------------------- ----------------------------- ------------------------- ----------------------------- ------------------------- ----------------------------- -------------- --------------- ------------------ ------------------ ------------------------------- ------------------ ------------------ ------------------------------ ------------------------------ -------------- ------------------------------- ----------------- ------------------- ------------------------------- ------------------------------- ------------------------------ ------------------------------ ------------------ ------------------------------ ------------------------------- ------------------- ------------------------------- ------------------------------ ------------------------------ --------------------------- ------------------------------- ------------------------------- ------------------------------ ----------------------- ---------------- ------------------------------ ------------------------------- ---------------- ------------------------------ ------------------------------ ------------------------------ ------------------------------ ------------------------------- ------------------------------ ------------------------------- ------------------------------ --------------------------- ------------------------------ ------------------------------- ------------------------------ -------------- --------------------- ------------------------------ ------------------------------ --------------------- --------------------------- --------------------------- ------------------------------ ------------------------------- ------------------------------ ---------------- ------------------------------- --------------------- --------------------- -------------------- ---------------- ------------------ -------------- -------------- ------------------ -------------- -------------- -------------- -------------- -------------- ------------------------- ------------------------------ -------------------------------------- ---------------- ---------------------------- ---------------- ------------------------- -------------- ------------------------- ------------------------- ------------------------------ ------------------------- ------------------------- ------------------------- ------------------------- ------------------------- ------------------------- ------------------------- ------------------------- ------------------------------ ----------------------- --------------- -------------- ------------ ------------- ------------- ------------- ------------- ------------- ------------- ------------- ------------- -------------
Total diff ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR REGR(+9.27%) REGR(+8.50%) REGR(+8.50%) REGR(+8.49%) REGR(+7.87%) REGR(+5.36%) REGR(+5.30%) REGR(+5.30%) REGR(+5.28%) REGR(+5.16%) REGR(+4.96%) REGR(+4.81%) REGR(+4.75%) REGR(+4.71%) REGR(+4.47%) REGR(+4.43%) REGR(+4.14%) REGR(+3.88%) REGR(+3.70%) REGR(+3.05%) REGR(+3.04%) REGR(+2.89%) REGR(+2.80%) REGR(+2.70%) REGR(+2.10%) REGR(+1.99%) REGR(+1.98%) REGR(+1.88%) REGR(+1.88%) REGR(+1.85%) REGR(+1.85%) REGR(+1.85%) REGR(+1.75%) REGR(+1.70%) REGR(+1.70%) REGR(+1.63%) REGR(+1.61%) REGR(+1.57%) REGR(+1.54%) REGR(+1.53%) REGR(+1.46%) REGR(+1.30%) REGR(+1.24%) REGR(+1.20%) REGR(+1.12%) REGR(+1.10%) REGR(+1.06%) REGR(+1.04%) REGR(+1.04%) REGR(+1.01%) REGR(+0.92%) REGR(+0.88%) REGR(+0.88%) REGR(+0.87%) REGR(+0.87%) REGR(+0.87%) REGR(+0.84%) REGR(+0.81%) REGR(+0.81%) REGR(+0.81%) REGR(+0.81%) REGR(+0.81%) REGR(+0.80%) REGR(+0.80%) REGR(+0.80%) REGR(+0.80%) REGR(+0.76%) REGR(+0.73%) REGR(+0.73%) REGR(+0.70%) REGR(+0.68%) REGR(+0.66%) REGR(+0.66%) REGR(+0.66%) REGR(+0.66%) REGR(+0.58%) REGR(+0.58%) REGR(+0.58%) REGR(+0.58%) REGR(+0.58%) REGR(+0.57%) REGR(+0.56%) REGR(+0.55%) REGR(+0.53%) REGR(+0.48%) REGR(+0.47%) REGR(+0.47%) REGR(+0.46%) REGR(+0.45%) REGR(+0.45%) REGR(+0.44%) REGR(+0.44%) REGR(+0.44%) REGR(+0.40%) REGR(+0.39%) REGR(+0.39%) REGR(+0.37%) REGR(+0.36%) REGR(+0.36%) REGR(+0.36%) REGR(+0.36%) REGR(+0.34%) REGR(+0.33%) REGR(+0.30%) REGR(+0.29%) REGR(+0.28%) REGR(+0.26%) REGR(+0.24%) REGR(+0.23%) REGR(+0.23%) REGR(+0.23%) REGR(+0.22%) REGR(+0.20%) REGR(+0.18%) REGR(+0.17%) REGR(+0.16%) REGR(+0.16%) REGR(+0.16%) REGR(+0.16%) REGR(+0.16%) REGR(+0.16%) REGR(+0.15%) REGR(+0.15%) REGR(+0.15%) REGR(+0.14%) REGR(+0.14%) REGR(+0.13%) REGR(+0.13%) REGR(+0.11%) REGR(+0.11%) REGR(+0.11%) REGR(+0.11%) REGR(+0.11%) REGR(+0.11%) REGR(+0.10%) SAME(+0.09%) SAME(+0.09%) SAME(+0.09%) SAME(+0.09%) SAME(+0.08%) SAME(+0.08%) SAME(+0.08%) SAME(+0.08%) SAME(+0.08%) SAME(+0.08%) SAME(+0.07%) SAME(+0.07%) SAME(+0.07%) SAME(+0.07%) SAME(+0.07%) SAME(+0.07%) SAME(+0.06%) SAME(+0.05%) SAME(+0.04%) SAME(+0.04%) SAME(+0.02%) SAME(+0.02%) SAME(+0.02%) SAME(+0.02%) SAME(+0.01%) SAME(+0.01%) SAME(+0.01%) SAME(+0.01%) SAME(+0.01%) SAME(+0.01%) SAME(+0.01%) SAME(+0.01%) SAME(+0.01%) SAME(+0.01%) SAME(+0.01%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(+0.00%) SAME(-0.01%) SAME(-0.03%) SAME(-0.03%) SAME(-0.03%) SAME(-0.03%) SAME(-0.03%) SAME(-0.04%) SAME(-0.04%) SAME(-0.04%) SAME(-0.04%) SAME(-0.05%) SAME(-0.05%) SAME(-0.06%) SAME(-0.06%) SAME(-0.07%) SAME(-0.07%) SAME(-0.07%) SAME(-0.08%) SAME(-0.08%) SAME(-0.08%) SAME(-0.09%) SAME(-0.09%) SAME(-0.09%) SAME(-0.09%) SAME(-0.09%) SAME(-0.10%) SAME(-0.10%) IMPR(-0.10%) IMPR(-0.11%) IMPR(-0.11%) IMPR(-0.11%) IMPR(-0.11%) IMPR(-0.11%) IMPR(-0.11%) IMPR(-0.11%) IMPR(-0.12%) IMPR(-0.12%) IMPR(-0.12%) IMPR(-0.12%) IMPR(-0.13%) IMPR(-0.13%) IMPR(-0.13%) IMPR(-0.13%) IMPR(-0.14%) IMPR(-0.14%) IMPR(-0.15%) IMPR(-0.20%) IMPR(-0.21%) IMPR(-0.22%) IMPR(-0.22%) IMPR(-0.22%) IMPR(-0.28%) IMPR(-0.32%) IMPR(-0.33%) IMPR(-0.33%) IMPR(-0.34%) IMPR(-0.34%) IMPR(-0.36%) IMPR(-0.48%) IMPR(-0.89%) IMPR(-1.17%) IMPR(-1.32%) IMPR(-1.34%) IMPR(-1.43%) IMPR(-2.07%) IMPR(-2.08%) IMPR(-2.38%) IMPR(-2.52%) IMPR(-2.66%) IMPR(-2.76%) IMPR(-2.97%) IMPR(-3.09%) IMPR(-3.35%) IMPR(-3.50%) IMPR(-3.74%) IMPR(-4.26%) IMPR(-4.29%) IMPR(-5.24%) IMPR(-5.28%) IMPR(-5.30%) IMPR(-5.53%) IMPR(-5.66%) IMPR(-5.88%) IMPR(-5.94%) IMPR(-6.75%) IMPR(-6.75%) IMPR(-6.75%) IMPR(-8.05%) IMPR(-8.54%) IMPR(-10.07%) IMPR(-10.12%) +0.10% 1.75 -0.12% +0.00% +0.00% +0.00% +0.00% +0.00% +0.01% +0.26% +0.88%
----------------------------------------------------------------- ---------------------------------------------- ------------------ ------------------------- ------------------------- ------------------------------ ------------------------------ ------------------------------ -------------------- -------------------- -------------------- ------------ ------------ ------------ ------------ ------------ ------------- ------------- ------------- ------------- -------------- -------------- -------------------- -------------------- -------------------- -------------------- -------------------- ---------------- ---------------- ---------------- ---------------- ---------------- ---------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ----------------------------------- ------------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- ---------------------------- --------------------------- --------------------------- --------------------------- --------------------------- --------------------------- --------------------------- --------------------------- --------------------------- --------------------------- --------------------------- --------------------------- --------------------------- --------------------------- --------------------------- -------------------------- ------------------------- ---------------- ---------------- ---------------- ---------------- ---------------- -------------- --------------- --------------- --------------- ---------------- ---------------- --------------- --------------- ---------------- ---------------- --------------- ---------------- -------------- ---------------- ---------------------- ------------------ -------------- ------------------------------- ---------------- ----------------- ----------------- ----------------- ----------------- -------------- -------------------- -------------- -------------- --------------- --------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- ---------------- -------------- -------------- -------------- ------------------------------ ---------------- -------------- -------------- -------------- -------------- -------------------- -------------- -------------- --------------- -------------- ----------------- -------------- -------------- --------------- -------------------------- -------------------------- ----------------------- -------------- -------------- -------------- -------------- --------------- -------------- -------------- ---------------- -------------- --------------- --------------- --------------- -------------- -------------- -------------- -------------- -------------- ----------------------- -------------- -------------- -------------- -------------- ---------------- -------------- -------------- -------------------------- ---------------- -------------- -------------- ------------------ ------------------------- -------------- -------------- -------------- ----------------- -------------- -------------- -------------- -------------- -------------- ------------------------------- -------------- -------------- -------------- ------------------------- ------------------------- -------------------- ------------------ ---------------- -------------------- --------------- -------------- ---------------- -------------- ------------------- -------------- ----------------------- -------------- -------------- ----------------------- ----------------------- ----------------------- -------------- ------------------ ----------------- ----------------------- -------------- ---------------- -------------- -------------- ----------------------- -------------- -------------- ----------------------- ---------------- ---------------- -------------- ------------------- -------------- -------------- ------------------ -------------- ----------------------- ----------------------- --------------- ---------------- ------------------- -------------- ----------------------- ----------------------- ---------------------- -------------- --------------- -------------------- ------------------ -------------- ------------------ --------------------- ----------------- ------------------------------ -------------- -------------- ----------------------- ----------------------- -------------- ----------------------- ----------------------- ----------------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------------- -------------------- -------------------- -------------------- -------------------- -------------------- -------------------- -------------------- -------------------- -------------- -------------- ------------------------------------ ------------------------------------ ---------------- ---------------------------- ------------------------ -------------- --------------------------- --------------- -------------------- ------------------- ------------------- ------------------ ---------------------- -------------------- ---------------------- ---------------------- ---------------- ------------------ ------------------ ---------------- ----------------------------- ----------------------------- ---------------- ---------------- ------------------------------------------- ------------------------------------------- -------------------------------------------------------------- ---------------------------------------------------------- -------------------------------------------------- ---------------------------------------------- -------------------------------------------------- ------------------------------------------------------------ ----------------------------------------------- -------------- -------------- -------------- --------------- ---------------- ---------------- ----------------------- ----------------------- ----------------------- ----------------------- ----------------------- ----------------------- ----------------------- ----------------------- ----------------------- ----------------------- ----------------------- ----------------------- -------------------------------------- -------------------------------------- ------------------------ ------------------------ ---------------------- ------------------ ---------------------- ------------------ ---------------- ---------------- ----------------- ----------------- ------------------------------- ---------------------- ------------------ -------------- -------------- ------------------------ ------------------------ -------------- -------------- -------------- -------------- -------------- -------------- ------------------------- ------------------------- --------------------- --------------------- --------------------- --------------------- --------------------- --------------------- --------------------- --------------------- --------------------- --------------------- ----------------------------- ----------------------------- -------------------- -------------------- -------------------- -------------------- -------------------- -------------------- -------------------- -------------------- ------------------------------- ------------------------------- ------------------ ------------------ ------------------------------- ------------------------------- ----------------------------------- ------------------------------- -------------- -------------- -------------- -------------- -------------- ------------------- ---------------------- ------------------ ------------------ ------------------ ------------------ ---------------- --------------- -------------- -------------- -------------- -------------- -------------------------------------- ------------------------ -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- ------------------------ ------------------------ -------------------------------------- -------------------------------------- -------------- ------------------- ------------------ ------------------ ------------------ ------------------ ----------------------- ----------------------- ------------------ ------------------ ------------------ ------------------ -------------- -------------- --------------------- -------------- -------------- ------------------- -------------- -------------- ------------------ ------------------ --------------- --------------- ---------------- ---------------- ------------------ ------------------ ------------------ ------------------------- ------------------------- ------------------------- ------------------------- ---------------- ---------------- ---------------- ---------------- ---------------- ---------------- ---------------- -------------- -------------- -------------- -------------- --------------- --------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------------- ---------------- -------------------------------------- -------------------------------------- ----------------------------- ----------------------------- ------------------------------------------- ----------------- ----------------- ------------------------------- ----------------------------- ------------------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- -------------- ------------------------------- --------------------------- ------------------ ------------------ --------------- --------------- --------------- --------------- --------------- --------------- --------------- --------------- --------------- --------------- --------------- --------------- ------------------------- ----------------------------- ------------------------- ----------------------------- ------------------------- ----------------------------- ------------------------- ----------------------------- ------------------------- ----------------------------- ------------------------- ----------------------------- ------------------------- ----------------------------- ------------------------- ----------------------------- ------------------------- ----------------------------- ------------------------- ----------------------------- -------------- --------------- ------------------ ------------------ ------------------------------- ------------------ ------------------ ------------------------------ ------------------------------ -------------- ------------------------------- ----------------- ------------------- ------------------------------- ------------------------------- ------------------------------ ------------------------------ ------------------ ------------------------------ ------------------------------- ------------------- ------------------------------- ------------------------------ ------------------------------ --------------------------- ------------------------------- ------------------------------- ------------------------------ ----------------------- ---------------- ------------------------------ ------------------------------- ---------------- ------------------------------ ------------------------------ ------------------------------ ------------------------------ ------------------------------- ------------------------------ ------------------------------- ------------------------------ --------------------------- ------------------------------ ------------------------------- ------------------------------ -------------- --------------------- ------------------------------ ------------------------------ --------------------- --------------------------- --------------------------- ------------------------------ ------------------------------- ------------------------------ ---------------- ------------------------------- --------------------- --------------------- -------------------- ---------------- ------------------ -------------- -------------- ------------------ -------------- -------------- -------------- -------------- -------------- ------------------------- ------------------------------ -------------------------------------- ---------------- ---------------------------- ---------------- ------------------------- -------------- ------------------------- ------------------------- ------------------------------ ------------------------- ------------------------- ------------------------- ------------------------- ------------------------- ------------------------- ------------------------- ------------------------- ------------------------------ ----------------------- --------------- -------------- ------------ ------------- ------------- ------------- ------------- ------------- ------------- ------------- ------------- -------------
andcarminati commented 2 weeks ago

As an insight about the regressions, are the worst ones related to bank conflicts (wait cycles) or just longer schedules? Or even a mix?

andcarminati commented 2 weeks ago

About QoR, I can see that some results are not present (like Reduce and Softmax). Do you know the reason?

krishnamtibrewala commented 2 weeks ago

As an insight about the regressions, are the worst ones related to bank conflicts (wait cycles) or just longer schedules? Or even a mix? --> If we are not able to reduce the schedule (i.e number of VLIW instr in the inner most loop) by the same number of bank conflict we see regression. I take a deeper look into multiple test case, one of them were Conv2D_bf16_1 where we see regression of REGR(+8.50%) here we end up introduction 6 bank conflict but the schedule of inner most loop is reduces only by 3 VLIW instruction if it was 6 then we should have seen it to be SAME.

I have been pondering on how we can automate turning on/off this feature without been too expensive

About QoR, I can see that some results are not present (like Reduce and Softmax). Do you know the reason? --> Not very sure currently, I triggered the complete L1 regression sweet.

andcarminati commented 1 week ago

I have a feeling that, before committing to a bank conflict, we should use a finer-grained heuristic to check if we reduce resource conflicts. We can get an inspiration on @martien-de-jong's work in PostPipeliner::getResMII

krishnamtibrewala commented 1 week ago

I have a feeling that, before committing to a bank conflict, we should use a finer-grained heuristic to check if we reduce resource conflicts. We can get an inspiration on @martien-de-jong's work in PostPipeliner::getResMII

Will look into it, I think we need to add an extra pass iteration of scheduler to see if we are able to reduce the number of VLIW instruction in a BB by the same or more number of times that of we are creating bank-conflict.