apache / doris

Apache Doris is an easy-to-use, high performance and unified analytics database.
https://doris.apache.org
Apache License 2.0
12.38k stars 3.22k forks source link

[fix](bloom filter)Fix drop column with bloom filter #41369

Open qidaye opened 5 days ago

qidaye commented 5 days ago

Proposed changes

Issue Number: close #41368

doris-robot commented 5 days ago

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website. See Doris Document.

qidaye commented 5 days ago

run buildall

github-actions[bot] commented 5 days ago

PR approved by at least one committer and no changes requested.

github-actions[bot] commented 5 days ago

PR approved by anyone and no changes requested.

doris-robot commented 5 days ago
TPC-H: Total hot run time: 40697 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 96977a45d4985d99039021badb7501e6b37daaf5, data reload: false ------ Round 1 ---------------------------------- q1 17599 7346 7232 7232 q2 2034 288 282 282 q3 12210 1065 1173 1065 q4 10569 737 787 737 q5 7734 2830 2801 2801 q6 240 149 148 148 q7 980 613 608 608 q8 9578 1930 1934 1930 q9 8170 6355 6404 6355 q10 6993 2253 2324 2253 q11 442 248 244 244 q12 416 215 221 215 q13 17792 2980 3013 2980 q14 234 215 216 215 q15 568 537 513 513 q16 654 593 573 573 q17 966 584 466 466 q18 7054 6706 6731 6706 q19 1391 1048 1048 1048 q20 484 194 192 192 q21 3941 3310 3141 3141 q22 1088 1025 993 993 Total cold run time: 111137 ms Total hot run time: 40697 ms ----- Round 2, with runtime_filter_mode=off ----- q1 7242 7172 7189 7172 q2 320 223 229 223 q3 3076 2885 2952 2885 q4 2100 1845 1800 1800 q5 5722 5783 5703 5703 q6 231 151 150 150 q7 2221 1859 1849 1849 q8 3374 3462 3475 3462 q9 8903 8812 8849 8812 q10 3601 3536 3520 3520 q11 588 487 493 487 q12 878 625 631 625 q13 8048 3180 3196 3180 q14 305 272 281 272 q15 588 514 534 514 q16 699 648 634 634 q17 1816 1627 1565 1565 q18 8316 7869 7481 7481 q19 1700 1528 1356 1356 q20 2117 1874 1888 1874 q21 5772 5293 5317 5293 q22 1137 1056 1028 1028 Total cold run time: 68754 ms Total hot run time: 59885 ms ```
doris-robot commented 5 days ago
TPC-DS: Total hot run time: 192543 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 96977a45d4985d99039021badb7501e6b37daaf5, data reload: false query1 858 391 420 391 query2 6304 2249 2065 2065 query3 8688 193 213 193 query4 33679 23597 23494 23494 query5 3411 464 460 460 query6 275 178 172 172 query7 4193 306 330 306 query8 298 238 208 208 query9 9252 2652 2677 2652 query10 458 269 271 269 query11 17975 15209 15143 15143 query12 157 95 97 95 query13 1519 426 424 424 query14 9591 7564 7662 7564 query15 256 172 180 172 query16 7916 497 490 490 query17 1636 609 588 588 query18 2002 327 339 327 query19 364 162 160 160 query20 124 112 111 111 query21 217 118 109 109 query22 4522 4520 4453 4453 query23 35568 34317 33912 33912 query24 11033 2796 2868 2796 query25 629 413 411 411 query26 1104 168 172 168 query27 2239 297 309 297 query28 7751 2420 2427 2420 query29 806 453 433 433 query30 258 153 152 152 query31 1032 809 810 809 query32 107 54 58 54 query33 771 301 299 299 query34 907 519 505 505 query35 856 734 729 729 query36 1105 981 957 957 query37 160 93 89 89 query38 3980 4033 3876 3876 query39 1513 1432 1425 1425 query40 218 98 99 98 query41 51 48 53 48 query42 115 98 96 96 query43 530 490 490 490 query44 1251 805 806 805 query45 201 166 168 166 query46 1159 736 726 726 query47 1948 1842 1851 1842 query48 477 391 378 378 query49 890 424 430 424 query50 821 416 414 414 query51 7026 7027 6944 6944 query52 103 88 97 88 query53 261 184 189 184 query54 1209 505 495 495 query55 84 79 80 79 query56 273 271 267 267 query57 1228 1108 1116 1108 query58 244 251 250 250 query59 3182 3157 2874 2874 query60 314 264 265 264 query61 102 104 102 102 query62 817 656 670 656 query63 221 192 194 192 query64 4007 657 618 618 query65 3276 3271 3221 3221 query66 1058 307 301 301 query67 15748 15487 15416 15416 query68 4704 584 557 557 query69 572 301 306 301 query70 1149 1075 1098 1075 query71 403 272 272 272 query72 7648 3990 4087 3990 query73 768 360 351 351 query74 10223 9235 9111 9111 query75 3993 2709 2694 2694 query76 3523 955 926 926 query77 695 302 289 289 query78 10497 9734 9582 9582 query79 4783 601 603 601 query80 1819 477 473 473 query81 587 242 252 242 query82 712 142 135 135 query83 322 133 136 133 query84 293 73 84 73 query85 1889 303 286 286 query86 445 305 305 305 query87 4482 4392 4371 4371 query88 4830 2409 2376 2376 query89 415 293 295 293 query90 1998 200 185 185 query91 185 141 149 141 query92 69 47 47 47 query93 3450 572 558 558 query94 870 306 307 306 query95 364 260 276 260 query96 636 284 289 284 query97 3250 3157 3098 3098 query98 227 196 194 194 query99 1535 1315 1310 1310 Total cold run time: 307664 ms Total hot run time: 192543 ms ```
doris-robot commented 5 days ago
ClickBench: Total hot run time: 32.72 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 96977a45d4985d99039021badb7501e6b37daaf5, data reload: false query1 0.05 0.05 0.04 query2 0.07 0.03 0.03 query3 0.23 0.07 0.07 query4 1.64 0.10 0.10 query5 0.49 0.50 0.49 query6 1.14 0.74 0.73 query7 0.02 0.01 0.01 query8 0.04 0.03 0.04 query9 0.55 0.50 0.49 query10 0.54 0.59 0.53 query11 0.13 0.11 0.11 query12 0.14 0.11 0.11 query13 0.60 0.61 0.60 query14 2.69 2.72 2.83 query15 0.91 0.82 0.82 query16 0.38 0.39 0.38 query17 1.01 1.02 1.06 query18 0.19 0.19 0.19 query19 1.93 1.84 1.98 query20 0.02 0.01 0.01 query21 15.49 0.59 0.59 query22 2.70 2.30 2.59 query23 17.30 0.84 0.83 query24 2.39 1.46 0.47 query25 0.21 0.11 0.14 query26 0.28 0.14 0.14 query27 0.04 0.05 0.04 query28 11.31 1.09 1.06 query29 12.60 3.24 3.24 query30 0.24 0.06 0.06 query31 2.89 0.38 0.38 query32 3.28 0.46 0.46 query33 3.01 3.00 3.00 query34 16.93 4.45 4.45 query35 4.51 4.50 4.52 query36 0.67 0.48 0.47 query37 0.08 0.06 0.06 query38 0.05 0.03 0.04 query39 0.04 0.02 0.02 query40 0.16 0.12 0.12 query41 0.08 0.02 0.03 query42 0.03 0.02 0.02 query43 0.04 0.03 0.03 Total cold run time: 107.1 s Total hot run time: 32.72 s ```