search

apache / doris

Apache Doris is an easy-to-use, high performance and unified analytics database.
https://doris.apache.org
Apache License 2.0
12.77k stars 3.29k forks source link

[Enhancement] (nereids)implement KILL COMMAND in nereids #44325

Open Yao-MR opened 2 days ago

Yao-MR commented 2 days ago

What problem does this PR solve?

Issue Number: close #42533

Related PR: NO

Problem Summary: Implement KILL COMMAND in nereids

Release note

Support KILL Commnad in nereids

Check List (For Author)

Check List (For Reviewer who merge this PR)

doris-robot commented 2 days ago

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?
Yao-MR commented 2 days ago
Clipboard_Screenshot_1732086655
doris-robot commented 1 day ago
TPC-H: Total hot run time: 40037 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 0b565282861e4b3428b23a98c578de13339b5ce0, data reload: false ------ Round 1 ---------------------------------- q1 17592 7483 7288 7288 q2 2044 168 170 168 q3 10615 1075 1200 1075 q4 10435 761 788 761 q5 7620 2708 2742 2708 q6 244 148 145 145 q7 986 633 610 610 q8 9245 1820 1931 1820 q9 6536 6474 6389 6389 q10 7002 2288 2278 2278 q11 466 257 272 257 q12 441 223 224 223 q13 17813 3057 3050 3050 q14 248 216 218 216 q15 562 545 510 510 q16 676 593 574 574 q17 975 510 566 510 q18 7340 6705 6708 6705 q19 1345 1043 989 989 q20 468 194 188 188 q21 4047 3267 3253 3253 q22 388 320 322 320 Total cold run time: 107088 ms Total hot run time: 40037 ms ----- Round 2, with runtime_filter_mode=off ----- q1 7273 7236 7259 7236 q2 331 231 240 231 q3 2972 2822 2937 2822 q4 2086 1796 1752 1752 q5 5699 5702 5678 5678 q6 228 136 142 136 q7 2264 1854 1782 1782 q8 3426 3520 3511 3511 q9 8856 8937 8950 8937 q10 3588 3568 3577 3568 q11 600 507 509 507 q12 833 651 612 612 q13 11652 3293 3265 3265 q14 322 283 278 278 q15 576 539 516 516 q16 683 642 641 641 q17 1861 1631 1577 1577 q18 8458 7852 7668 7668 q19 1788 1626 1410 1410 q20 2134 1946 1866 1866 q21 5711 5499 5506 5499 q22 646 622 596 596 Total cold run time: 71987 ms Total hot run time: 60088 ms ```
doris-robot commented 1 day ago
TPC-DS: Total hot run time: 197162 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 0b565282861e4b3428b23a98c578de13339b5ce0, data reload: false query1 1230 912 942 912 query2 6246 2190 2166 2166 query3 10812 4099 3879 3879 query4 67741 28369 23634 23634 query5 4895 486 460 460 query6 408 181 199 181 query7 5561 308 301 301 query8 311 231 239 231 query9 8779 2711 2670 2670 query10 436 271 255 255 query11 17390 15319 16017 15319 query12 156 104 102 102 query13 1474 409 429 409 query14 9956 8098 7947 7947 query15 220 183 195 183 query16 7105 440 460 440 query17 1003 606 562 562 query18 1774 288 290 288 query19 198 147 147 147 query20 116 109 116 109 query21 205 99 102 99 query22 4384 4173 4343 4173 query23 35064 34359 34117 34117 query24 5358 2527 2604 2527 query25 511 391 389 389 query26 647 156 156 156 query27 1666 286 290 286 query28 4202 2445 2420 2420 query29 660 411 407 407 query30 214 151 152 151 query31 1002 819 828 819 query32 73 55 59 55 query33 402 284 286 284 query34 947 521 525 521 query35 823 754 731 731 query36 1069 979 974 974 query37 123 75 74 74 query38 4312 4193 4284 4193 query39 1482 1415 1433 1415 query40 199 108 99 99 query41 46 42 46 42 query42 115 101 100 100 query43 567 518 510 510 query44 1189 809 826 809 query45 188 165 165 165 query46 1155 718 698 698 query47 1919 1810 1834 1810 query48 416 321 309 309 query49 714 387 388 387 query50 826 390 410 390 query51 7313 7112 7169 7112 query52 108 90 95 90 query53 270 185 188 185 query54 529 398 393 393 query55 81 80 82 80 query56 259 238 249 238 query57 1290 1171 1139 1139 query58 224 225 233 225 query59 3465 3232 3187 3187 query60 295 275 256 256 query61 137 128 131 128 query62 813 681 686 681 query63 231 192 190 190 query64 1467 811 631 631 query65 3334 3263 3263 3263 query66 710 307 317 307 query67 15952 15553 15783 15553 query68 3648 584 567 567 query69 426 271 255 255 query70 1230 1153 1151 1151 query71 355 264 262 262 query72 6221 3891 4057 3891 query73 791 364 358 358 query74 10260 9009 9045 9009 query75 3436 2705 2745 2705 query76 1870 1087 1077 1077 query77 539 293 280 280 query78 10576 9395 9407 9395 query79 2037 608 620 608 query80 1324 468 445 445 query81 520 243 239 239 query82 838 127 123 123 query83 181 162 149 149 query84 278 71 72 71 query85 959 294 307 294 query86 400 303 290 290 query87 4685 4608 4619 4608 query88 3793 2232 2185 2185 query89 428 296 349 296 query90 1982 190 188 188 query91 137 112 107 107 query92 65 53 52 52 query93 2687 558 548 548 query94 886 300 299 299 query95 358 257 257 257 query96 657 274 287 274 query97 2842 2723 2702 2702 query98 223 209 195 195 query99 1621 1331 1319 1319 Total cold run time: 319020 ms Total hot run time: 197162 ms ```
doris-robot commented 1 day ago
ClickBench: Total hot run time: 32.93 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 0b565282861e4b3428b23a98c578de13339b5ce0, data reload: false query1 0.04 0.03 0.02 query2 0.06 0.03 0.03 query3 0.22 0.08 0.07 query4 1.61 0.10 0.10 query5 0.44 0.40 0.39 query6 1.14 0.66 0.65 query7 0.02 0.02 0.02 query8 0.04 0.03 0.03 query9 0.56 0.50 0.50 query10 0.57 0.54 0.55 query11 0.15 0.09 0.10 query12 0.13 0.12 0.12 query13 0.62 0.60 0.61 query14 2.71 2.74 2.80 query15 0.90 0.84 0.83 query16 0.39 0.38 0.37 query17 1.04 1.06 1.06 query18 0.20 0.20 0.21 query19 1.93 1.82 1.96 query20 0.01 0.01 0.01 query21 15.36 0.60 0.60 query22 2.78 2.41 1.98 query23 16.95 0.92 0.87 query24 2.88 1.14 1.20 query25 0.18 0.14 0.10 query26 0.56 0.14 0.14 query27 0.04 0.04 0.04 query28 10.59 1.10 1.08 query29 12.56 3.22 3.23 query30 0.25 0.06 0.06 query31 2.89 0.37 0.39 query32 3.25 0.47 0.48 query33 3.08 2.98 3.09 query34 17.01 4.44 4.49 query35 4.55 4.47 4.46 query36 0.67 0.50 0.47 query37 0.09 0.06 0.06 query38 0.05 0.04 0.04 query39 0.03 0.02 0.02 query40 0.15 0.13 0.14 query41 0.07 0.02 0.02 query42 0.03 0.02 0.02 query43 0.04 0.03 0.03 Total cold run time: 106.84 s Total hot run time: 32.93 s ```
Yao-MR commented 9 hours ago

run p0

Yao-MR commented 9 hours ago

run buildall

doris-robot commented 8 hours ago
TPC-H: Total hot run time: 40017 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 4e5b731346a121b9fed31dbac326d218b62b0490, data reload: false ------ Round 1 ---------------------------------- q1 17596 7463 7272 7272 q2 2044 173 165 165 q3 10621 1105 1156 1105 q4 10566 707 651 651 q5 7607 2724 2727 2724 q6 243 148 151 148 q7 984 613 614 613 q8 9224 1821 1916 1821 q9 6575 6395 6418 6395 q10 6992 2332 2319 2319 q11 452 261 268 261 q12 429 220 214 214 q13 17771 3037 3005 3005 q14 238 218 214 214 q15 563 541 525 525 q16 623 585 601 585 q17 967 553 509 509 q18 7188 6637 6847 6637 q19 1341 1051 1109 1051 q20 475 185 178 178 q21 4156 3638 3310 3310 q22 375 316 315 315 Total cold run time: 107030 ms Total hot run time: 40017 ms ----- Round 2, with runtime_filter_mode=off ----- q1 7248 7202 7205 7202 q2 340 244 227 227 q3 2893 2804 2923 2804 q4 2116 1861 1897 1861 q5 5660 5669 5627 5627 q6 227 139 145 139 q7 2277 1818 1777 1777 q8 3426 3535 3805 3535 q9 8838 8924 8945 8924 q10 3619 3545 3556 3545 q11 596 533 520 520 q12 816 638 610 610 q13 11652 3383 3246 3246 q14 308 283 275 275 q15 573 540 516 516 q16 689 671 640 640 q17 1841 1651 1616 1616 q18 8200 7903 7609 7609 q19 1680 1645 1584 1584 q20 2096 1870 1891 1870 q21 5591 5425 5249 5249 q22 625 576 561 561 Total cold run time: 71311 ms Total hot run time: 59937 ms ```
doris-robot commented 8 hours ago
TPC-DS: Total hot run time: 197441 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 4e5b731346a121b9fed31dbac326d218b62b0490, data reload: false query1 1282 959 904 904 query2 6242 2123 2032 2032 query3 10764 3985 3895 3895 query4 67743 29376 23558 23558 query5 4989 468 461 461 query6 433 189 192 189 query7 5562 324 293 293 query8 315 231 231 231 query9 8879 2684 2677 2677 query10 460 255 255 255 query11 17206 15211 15823 15211 query12 160 112 113 112 query13 1523 425 431 425 query14 10769 7185 7641 7185 query15 213 202 187 187 query16 7010 497 454 454 query17 1057 556 551 551 query18 1855 298 300 298 query19 201 175 151 151 query20 113 115 114 114 query21 208 100 106 100 query22 4761 4541 4768 4541 query23 35356 34599 34448 34448 query24 5360 2545 2480 2480 query25 494 400 389 389 query26 638 150 152 150 query27 1783 278 289 278 query28 4714 2546 2468 2468 query29 672 427 438 427 query30 219 148 151 148 query31 998 830 842 830 query32 73 54 67 54 query33 450 283 296 283 query34 922 525 535 525 query35 859 727 727 727 query36 1098 972 964 964 query37 121 69 74 69 query38 4466 4322 4457 4322 query39 1528 1506 1505 1505 query40 212 103 106 103 query41 46 47 48 47 query42 113 101 102 101 query43 538 515 522 515 query44 1217 845 854 845 query45 186 173 166 166 query46 1144 723 738 723 query47 2041 1930 1956 1930 query48 424 336 349 336 query49 751 421 471 421 query50 882 393 401 393 query51 7451 7320 7109 7109 query52 95 88 90 88 query53 250 179 183 179 query54 513 393 408 393 query55 75 77 75 75 query56 243 240 246 240 query57 1323 1173 1168 1168 query58 217 204 213 204 query59 3338 3260 3155 3155 query60 264 240 247 240 query61 111 102 106 102 query62 796 672 659 659 query63 215 191 198 191 query64 1407 680 658 658 query65 3321 3203 3226 3203 query66 698 313 332 313 query67 16135 15770 15795 15770 query68 3923 581 572 572 query69 438 259 254 254 query70 1188 1124 1146 1124 query71 347 254 261 254 query72 6210 4039 4058 4039 query73 840 365 362 362 query74 10170 9050 9045 9045 query75 3371 2645 2657 2645 query76 1841 1142 1118 1118 query77 467 278 292 278 query78 10986 9456 9507 9456 query79 2565 590 610 590 query80 1275 441 436 436 query81 534 235 225 225 query82 1268 120 117 117 query83 251 151 156 151 query84 291 77 72 72 query85 998 307 305 305 query86 409 276 304 276 query87 4767 4650 4495 4495 query88 4027 2247 2223 2223 query89 425 338 297 297 query90 2023 188 189 188 query91 134 103 103 103 query92 74 51 54 51 query93 3190 553 556 553 query94 879 303 295 295 query95 353 258 251 251 query96 643 277 277 277 query97 2890 2725 2690 2690 query98 220 192 196 192 query99 1563 1289 1323 1289 Total cold run time: 324062 ms Total hot run time: 197441 ms ```
doris-robot commented 8 hours ago
ClickBench: Total hot run time: 32.21 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 4e5b731346a121b9fed31dbac326d218b62b0490, data reload: false query1 0.03 0.03 0.03 query2 0.07 0.03 0.03 query3 0.23 0.07 0.07 query4 1.63 0.10 0.10 query5 0.42 0.41 0.43 query6 1.20 0.66 0.66 query7 0.02 0.01 0.01 query8 0.04 0.04 0.03 query9 0.58 0.51 0.51 query10 0.56 0.56 0.56 query11 0.14 0.11 0.10 query12 0.14 0.11 0.12 query13 0.60 0.61 0.60 query14 2.71 2.73 2.69 query15 0.89 0.82 0.82 query16 0.38 0.39 0.37 query17 1.00 1.07 1.06 query18 0.23 0.21 0.20 query19 1.96 1.88 1.98 query20 0.01 0.01 0.01 query21 15.36 0.61 0.58 query22 2.40 1.90 1.47 query23 16.92 0.83 0.79 query24 3.78 0.97 1.93 query25 0.15 0.28 0.06 query26 0.50 0.14 0.13 query27 0.06 0.04 0.04 query28 9.74 1.10 1.07 query29 12.51 3.30 3.25 query30 0.25 0.06 0.06 query31 2.87 0.38 0.37 query32 3.28 0.46 0.47 query33 2.98 3.01 3.01 query34 16.97 4.44 4.44 query35 4.49 4.48 4.50 query36 0.65 0.50 0.47 query37 0.09 0.06 0.06 query38 0.05 0.04 0.04 query39 0.04 0.02 0.03 query40 0.16 0.14 0.12 query41 0.08 0.02 0.02 query42 0.03 0.03 0.02 query43 0.04 0.04 0.03 Total cold run time: 106.24 s Total hot run time: 32.21 s ```