apache / doris

Apache Doris is an easy-to-use, high performance and unified analytics database.
https://doris.apache.org
Apache License 2.0
11.8k stars 3.11k forks source link

[fix](group commit) remove non pipeline code #37018

Open mymeiyi opened 3 days ago

mymeiyi commented 3 days ago

Proposed changes

remove non pipilene code in group_commit_mgr

doris-robot commented 3 days ago

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website. See Doris Document.

mymeiyi commented 3 days ago

run buildall

github-actions[bot] commented 3 days ago

clang-tidy review says "All clean, LGTM! :+1:"

doris-robot commented 3 days ago
TPC-H: Total hot run time: 40208 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 7049cc613fc59f150ccb18aa7e0dcf7cc0d6b8c0, data reload: false ------ Round 1 ---------------------------------- q1 17632 6051 4354 4354 q2 2033 197 199 197 q3 10572 1217 1109 1109 q4 10356 808 799 799 q5 7533 2705 2666 2666 q6 224 140 140 140 q7 972 600 615 600 q8 9222 2109 2093 2093 q9 9077 6588 6561 6561 q10 8912 3733 3754 3733 q11 474 237 246 237 q12 404 241 243 241 q13 17775 2967 3011 2967 q14 273 224 223 223 q15 508 475 470 470 q16 489 380 375 375 q17 979 663 750 663 q18 8208 7547 7503 7503 q19 9069 1469 1474 1469 q20 685 320 332 320 q21 4986 3145 3951 3145 q22 409 343 347 343 Total cold run time: 120792 ms Total hot run time: 40208 ms ----- Round 2, with runtime_filter_mode=off ----- q1 4424 4258 4316 4258 q2 371 261 265 261 q3 3022 2787 2757 2757 q4 1874 1603 1600 1600 q5 5242 5308 5305 5305 q6 219 128 133 128 q7 2170 1721 1773 1721 q8 3226 3372 3339 3339 q9 8423 8385 8406 8385 q10 3940 3647 3695 3647 q11 583 502 498 498 q12 792 597 579 579 q13 17487 3001 2967 2967 q14 294 285 263 263 q15 517 492 477 477 q16 463 427 418 418 q17 1842 1486 1473 1473 q18 7461 7596 7346 7346 q19 1739 1514 1554 1514 q20 1973 1823 1775 1775 q21 4834 4719 4772 4719 q22 607 529 545 529 Total cold run time: 71503 ms Total hot run time: 53959 ms ```
doris-robot commented 3 days ago
TPC-DS: Total hot run time: 173449 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 7049cc613fc59f150ccb18aa7e0dcf7cc0d6b8c0, data reload: false query1 914 386 393 386 query2 6455 2489 2369 2369 query3 6654 209 218 209 query4 19568 17745 17313 17313 query5 4195 486 494 486 query6 266 171 164 164 query7 4600 312 298 298 query8 308 282 278 278 query9 8716 2482 2476 2476 query10 614 306 283 283 query11 10517 10071 10146 10071 query12 139 86 86 86 query13 1649 376 368 368 query14 10150 6654 7797 6654 query15 221 187 188 187 query16 7835 273 278 273 query17 1884 560 553 553 query18 1970 285 295 285 query19 212 169 159 159 query20 96 85 98 85 query21 210 133 123 123 query22 4403 4015 4120 4015 query23 33912 33148 33128 33128 query24 12095 2823 2828 2823 query25 690 385 381 381 query26 1843 155 156 155 query27 2973 330 315 315 query28 7296 2148 2133 2133 query29 1181 634 620 620 query30 280 156 154 154 query31 939 760 752 752 query32 98 54 56 54 query33 779 299 304 299 query34 918 469 483 469 query35 773 656 625 625 query36 1107 929 952 929 query37 257 72 72 72 query38 2883 2755 2756 2755 query39 860 819 805 805 query40 282 128 127 127 query41 51 51 55 51 query42 120 100 104 100 query43 622 562 565 562 query44 1183 751 764 751 query45 198 167 163 163 query46 1087 748 720 720 query47 1929 1790 1817 1790 query48 385 305 303 303 query49 1223 431 434 431 query50 778 395 398 395 query51 6887 6736 6708 6708 query52 102 99 93 93 query53 365 299 293 293 query54 961 451 464 451 query55 80 75 76 75 query56 305 283 284 283 query57 1153 1057 1045 1045 query58 260 252 250 250 query59 3417 3387 3196 3196 query60 299 284 271 271 query61 90 89 92 89 query62 646 466 445 445 query63 327 289 283 283 query64 9858 2239 1790 1790 query65 3194 3128 3149 3128 query66 1371 333 326 326 query67 15531 15121 14934 14934 query68 8851 568 571 568 query69 719 488 463 463 query70 1390 1135 1115 1115 query71 546 280 277 277 query72 8851 5710 5308 5308 query73 2235 329 325 325 query74 6061 5464 5496 5464 query75 5068 2657 2662 2657 query76 5364 948 896 896 query77 724 309 304 304 query78 10563 9942 9739 9739 query79 8823 530 526 526 query80 1170 478 468 468 query81 554 220 223 220 query82 539 101 100 100 query83 308 167 165 165 query84 270 91 82 82 query85 1123 286 265 265 query86 392 313 320 313 query87 3327 3067 3114 3067 query88 4611 2421 2364 2364 query89 530 385 384 384 query90 1972 192 193 192 query91 127 99 103 99 query92 64 50 51 50 query93 6830 531 521 521 query94 1216 191 188 188 query95 405 325 318 318 query96 596 270 271 270 query97 3235 3056 3055 3055 query98 229 198 203 198 query99 1227 845 851 845 Total cold run time: 301084 ms Total hot run time: 173449 ms ```
doris-robot commented 3 days ago
ClickBench: Total hot run time: 30.48 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 7049cc613fc59f150ccb18aa7e0dcf7cc0d6b8c0, data reload: false query1 0.04 0.03 0.03 query2 0.07 0.04 0.04 query3 0.22 0.05 0.05 query4 1.68 0.08 0.10 query5 0.51 0.49 0.49 query6 1.13 0.72 0.72 query7 0.02 0.02 0.02 query8 0.05 0.04 0.04 query9 0.54 0.49 0.48 query10 0.55 0.54 0.53 query11 0.15 0.11 0.12 query12 0.16 0.12 0.11 query13 0.59 0.58 0.60 query14 0.76 0.79 0.78 query15 0.85 0.81 0.82 query16 0.36 0.37 0.37 query17 0.98 1.01 1.03 query18 0.23 0.24 0.27 query19 1.91 1.68 1.81 query20 0.02 0.01 0.01 query21 15.44 0.76 0.64 query22 4.46 7.04 1.87 query23 18.29 1.42 1.27 query24 2.09 0.22 0.22 query25 0.16 0.10 0.08 query26 0.26 0.18 0.17 query27 0.08 0.07 0.07 query28 13.30 1.01 1.00 query29 12.64 3.26 3.22 query30 0.26 0.08 0.06 query31 2.94 0.39 0.39 query32 3.21 0.47 0.48 query33 2.87 2.93 2.88 query34 17.00 4.45 4.44 query35 4.53 4.47 4.48 query36 0.66 0.46 0.48 query37 0.18 0.15 0.15 query38 0.16 0.14 0.15 query39 0.04 0.03 0.04 query40 0.19 0.14 0.13 query41 0.09 0.05 0.05 query42 0.05 0.05 0.05 query43 0.04 0.04 0.04 Total cold run time: 109.76 s Total hot run time: 30.48 s ```