search

apache / doris

Apache Doris is an easy-to-use, high performance and unified analytics database.
https://doris.apache.org
Apache License 2.0
12.77k stars 3.29k forks source link

[feat](test) add bloomfilter ut case #44351

Open airborne12 opened 1 day ago

airborne12 commented 1 day ago

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

Check List (For Reviewer who merge this PR)

doris-robot commented 1 day ago

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?
airborne12 commented 1 day ago

run buildall

doris-robot commented 1 day ago
TPC-H: Total hot run time: 39852 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit d4ed7c81cb4ffbb4f21141eb129c02f6e1f850c5, data reload: false ------ Round 1 ---------------------------------- q1 17704 7476 7280 7280 q2 2038 168 164 164 q3 10821 1099 1152 1099 q4 10563 765 741 741 q5 7608 2717 2682 2682 q6 237 147 143 143 q7 956 614 607 607 q8 9223 1882 1947 1882 q9 6528 6379 6369 6369 q10 6979 2319 2324 2319 q11 475 262 255 255 q12 430 221 210 210 q13 17764 3011 3059 3011 q14 239 212 218 212 q15 583 532 509 509 q16 668 587 575 575 q17 970 483 521 483 q18 7225 6696 6783 6696 q19 1349 1065 1003 1003 q20 466 182 181 181 q21 3986 3193 3118 3118 q22 368 313 320 313 Total cold run time: 107180 ms Total hot run time: 39852 ms ----- Round 2, with runtime_filter_mode=off ----- q1 7239 7219 7191 7191 q2 320 232 222 222 q3 2935 2814 2949 2814 q4 2044 1828 1780 1780 q5 5693 5682 5661 5661 q6 222 141 139 139 q7 2249 1866 1827 1827 q8 3445 3543 3491 3491 q9 8848 8876 8892 8876 q10 3584 3547 3556 3547 q11 599 506 503 503 q12 838 627 615 615 q13 10641 3313 3203 3203 q14 316 273 289 273 q15 590 541 525 525 q16 686 654 639 639 q17 1841 1640 1586 1586 q18 8270 7800 7564 7564 q19 1696 1587 1592 1587 q20 2098 1878 1859 1859 q21 5582 5361 5474 5361 q22 718 583 593 583 Total cold run time: 70454 ms Total hot run time: 59846 ms ```
doris-robot commented 1 day ago
TPC-DS: Total hot run time: 196097 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit d4ed7c81cb4ffbb4f21141eb129c02f6e1f850c5, data reload: false query1 1241 939 956 939 query2 6247 2161 2150 2150 query3 10799 4155 4067 4067 query4 67525 29004 23643 23643 query5 4952 441 452 441 query6 413 187 194 187 query7 5502 302 296 296 query8 320 226 230 226 query9 8535 2672 2673 2672 query10 447 252 255 252 query11 17330 15186 15870 15186 query12 149 103 109 103 query13 1510 416 422 416 query14 10544 7508 7076 7076 query15 208 194 207 194 query16 7070 429 478 429 query17 989 560 548 548 query18 1813 292 280 280 query19 200 161 146 146 query20 113 119 111 111 query21 205 97 109 97 query22 4687 4433 4365 4365 query23 34638 34179 33930 33930 query24 5315 2472 2447 2447 query25 464 390 385 385 query26 641 154 152 152 query27 1683 294 290 290 query28 4041 2466 2422 2422 query29 691 438 447 438 query30 213 151 146 146 query31 1015 832 817 817 query32 66 59 61 59 query33 396 293 290 290 query34 936 514 525 514 query35 841 705 713 705 query36 1083 941 962 941 query37 116 74 81 74 query38 4337 4367 4254 4254 query39 1552 1429 1562 1429 query40 199 100 100 100 query41 90 47 42 42 query42 103 94 101 94 query43 539 506 518 506 query44 1175 820 820 820 query45 181 162 165 162 query46 1135 681 676 676 query47 1947 1863 1832 1832 query48 411 321 322 321 query49 715 385 386 385 query50 805 380 417 380 query51 7224 7174 7102 7102 query52 100 90 95 90 query53 253 176 182 176 query54 518 400 389 389 query55 82 75 80 75 query56 256 231 249 231 query57 1327 1190 1149 1149 query58 226 217 223 217 query59 3343 3206 3322 3206 query60 288 248 245 245 query61 141 109 107 107 query62 787 675 659 659 query63 211 190 196 190 query64 1399 683 648 648 query65 3335 3184 3223 3184 query66 719 319 316 316 query67 15987 15787 15713 15713 query68 3974 573 544 544 query69 431 256 256 256 query70 1144 1168 1146 1146 query71 359 250 255 250 query72 6413 4073 3946 3946 query73 767 355 366 355 query74 10238 8950 8976 8950 query75 3405 2695 2671 2671 query76 1804 1025 996 996 query77 499 278 288 278 query78 10627 9584 9429 9429 query79 1994 611 603 603 query80 1400 425 429 425 query81 526 235 229 229 query82 578 116 115 115 query83 190 155 159 155 query84 278 71 74 71 query85 985 309 296 296 query86 418 312 306 306 query87 4706 4661 4569 4569 query88 3760 2226 2192 2192 query89 433 297 294 294 query90 2032 188 191 188 query91 131 101 101 101 query92 66 50 54 50 query93 2812 552 546 546 query94 916 291 290 290 query95 356 248 247 247 query96 638 286 294 286 query97 2941 2688 2717 2688 query98 216 202 196 196 query99 1583 1306 1297 1297 Total cold run time: 318943 ms Total hot run time: 196097 ms ```
doris-robot commented 1 day ago
ClickBench: Total hot run time: 32.61 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit d4ed7c81cb4ffbb4f21141eb129c02f6e1f850c5, data reload: false query1 0.03 0.03 0.03 query2 0.06 0.04 0.03 query3 0.24 0.08 0.07 query4 1.59 0.11 0.10 query5 0.44 0.43 0.41 query6 1.17 0.65 0.66 query7 0.02 0.01 0.02 query8 0.04 0.03 0.03 query9 0.59 0.50 0.50 query10 0.56 0.55 0.56 query11 0.14 0.10 0.10 query12 0.14 0.11 0.11 query13 0.61 0.60 0.59 query14 2.74 2.77 2.83 query15 0.90 0.83 0.81 query16 0.39 0.40 0.37 query17 1.06 1.05 1.04 query18 0.20 0.20 0.19 query19 1.96 1.88 2.01 query20 0.01 0.01 0.01 query21 15.38 0.61 0.60 query22 2.72 2.78 1.67 query23 17.08 0.96 0.86 query24 3.36 1.18 1.40 query25 0.44 0.09 0.08 query26 0.36 0.13 0.14 query27 0.06 0.04 0.04 query28 9.98 1.10 1.07 query29 12.52 3.20 3.17 query30 0.25 0.07 0.06 query31 2.86 0.39 0.37 query32 3.27 0.47 0.46 query33 2.98 3.01 3.04 query34 17.27 4.45 4.43 query35 4.49 4.44 4.48 query36 0.66 0.49 0.48 query37 0.09 0.06 0.06 query38 0.04 0.03 0.04 query39 0.04 0.03 0.02 query40 0.17 0.12 0.13 query41 0.08 0.03 0.03 query42 0.04 0.02 0.02 query43 0.03 0.03 0.03 Total cold run time: 107.06 s Total hot run time: 32.61 s ```
doris-robot commented 1 day ago

TeamCity be ut coverage result: Function Coverage: 38.07% (9913/26039) Line Coverage: 29.25% (82939/283545) Region Coverage: 28.39% (42604/150083) Branch Coverage: 24.94% (21594/86590) Coverage Report: http://coverage.selectdb-in.cc/coverage/d4ed7c81cb4ffbb4f21141eb129c02f6e1f850c5_d4ed7c81cb4ffbb4f21141eb129c02f6e1f850c5/report/index.html

airborne12 commented 15 hours ago

run buildall

doris-robot commented 14 hours ago
TPC-H: Total hot run time: 40294 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit ca998c7c1bebba900a1c0d09740aa17ee570fa1a, data reload: false ------ Round 1 ---------------------------------- q1 17658 7635 7361 7361 q2 2052 182 185 182 q3 10631 1116 1183 1116 q4 10315 751 779 751 q5 7606 2764 2702 2702 q6 241 148 148 148 q7 995 622 596 596 q8 9227 1933 1951 1933 q9 6592 6455 6511 6455 q10 7067 2302 2316 2302 q11 475 264 261 261 q12 419 219 218 218 q13 17780 2990 3032 2990 q14 256 230 226 226 q15 590 531 525 525 q16 673 582 596 582 q17 998 573 562 562 q18 7437 6624 6772 6624 q19 1378 1036 1050 1036 q20 482 182 190 182 q21 3984 3314 3228 3228 q22 371 318 314 314 Total cold run time: 107227 ms Total hot run time: 40294 ms ----- Round 2, with runtime_filter_mode=off ----- q1 7253 7252 7279 7252 q2 329 226 231 226 q3 2926 2839 2964 2839 q4 2024 1822 1833 1822 q5 5758 5675 5664 5664 q6 224 146 148 146 q7 2244 1843 1818 1818 q8 3438 3611 3565 3565 q9 8861 8940 8907 8907 q10 3633 3540 3594 3540 q11 604 500 502 500 q12 850 595 599 595 q13 10717 3254 3231 3231 q14 302 286 269 269 q15 556 528 543 528 q16 688 647 623 623 q17 1899 1637 1626 1626 q18 8417 7798 7585 7585 q19 1722 1590 1681 1590 q20 2112 1921 1878 1878 q21 5603 5492 5423 5423 q22 646 578 583 578 Total cold run time: 70806 ms Total hot run time: 60205 ms ```
doris-robot commented 14 hours ago
TPC-DS: Total hot run time: 197316 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit ca998c7c1bebba900a1c0d09740aa17ee570fa1a, data reload: false query1 1247 938 965 938 query2 6246 2114 2044 2044 query3 10868 3940 4006 3940 query4 68264 28011 23551 23551 query5 4876 465 459 459 query6 421 192 179 179 query7 5551 310 288 288 query8 308 228 222 222 query9 8779 2685 2687 2685 query10 440 259 239 239 query11 17153 15420 16032 15420 query12 165 105 106 105 query13 1509 447 444 444 query14 9997 7608 7480 7480 query15 211 186 215 186 query16 7149 478 456 456 query17 1290 586 580 580 query18 1815 343 300 300 query19 194 162 157 157 query20 119 110 112 110 query21 209 105 101 101 query22 4893 4810 4769 4769 query23 35132 34490 34264 34264 query24 5711 2492 2480 2480 query25 487 380 386 380 query26 648 147 141 141 query27 1901 279 292 279 query28 4302 2493 2465 2465 query29 700 437 406 406 query30 217 146 146 146 query31 970 824 836 824 query32 70 56 56 56 query33 423 287 276 276 query34 926 517 560 517 query35 867 751 723 723 query36 1080 966 962 962 query37 124 75 74 74 query38 4560 4413 4434 4413 query39 1522 1499 1473 1473 query40 204 96 96 96 query41 49 41 47 41 query42 109 97 99 97 query43 547 498 507 498 query44 1192 850 835 835 query45 195 165 163 163 query46 1172 714 704 704 query47 2059 1929 1953 1929 query48 414 336 320 320 query49 713 380 380 380 query50 844 428 408 408 query51 7376 7192 7128 7128 query52 98 86 87 86 query53 253 176 170 170 query54 499 391 393 391 query55 82 73 72 72 query56 249 229 232 229 query57 1288 1154 1172 1154 query58 217 206 215 206 query59 3229 3206 3062 3062 query60 267 248 243 243 query61 108 109 109 109 query62 798 670 656 656 query63 219 178 180 178 query64 1376 641 625 625 query65 3295 3180 3218 3180 query66 704 300 309 300 query67 15907 15660 15737 15660 query68 4041 556 560 556 query69 443 245 252 245 query70 1193 1127 1166 1127 query71 366 246 250 246 query72 6212 4127 3993 3993 query73 778 354 356 354 query74 10180 8987 8951 8951 query75 3392 2708 2655 2655 query76 1876 1064 1029 1029 query77 492 267 282 267 query78 10484 9485 9365 9365 query79 2156 678 611 611 query80 1410 425 425 425 query81 524 231 229 229 query82 1263 118 114 114 query83 253 142 147 142 query84 274 83 66 66 query85 984 294 293 293 query86 414 304 303 303 query87 4720 4526 4532 4526 query88 3779 2229 2215 2215 query89 422 297 305 297 query90 1930 186 182 182 query91 134 103 149 103 query92 64 47 49 47 query93 3011 547 539 539 query94 828 297 289 289 query95 357 245 252 245 query96 638 287 282 282 query97 2861 2696 2706 2696 query98 211 198 202 198 query99 1614 1274 1297 1274 Total cold run time: 322111 ms Total hot run time: 197316 ms ```
doris-robot commented 13 hours ago
ClickBench: Total hot run time: 32.49 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit ca998c7c1bebba900a1c0d09740aa17ee570fa1a, data reload: false query1 0.03 0.03 0.03 query2 0.07 0.03 0.03 query3 0.23 0.07 0.07 query4 1.61 0.11 0.11 query5 0.43 0.40 0.42 query6 1.16 0.67 0.64 query7 0.02 0.02 0.02 query8 0.04 0.03 0.03 query9 0.58 0.51 0.51 query10 0.55 0.53 0.55 query11 0.14 0.10 0.10 query12 0.14 0.12 0.12 query13 0.62 0.59 0.60 query14 2.72 2.80 2.77 query15 0.89 0.81 0.82 query16 0.37 0.37 0.38 query17 1.05 1.05 1.06 query18 0.23 0.21 0.20 query19 1.95 1.83 1.97 query20 0.02 0.01 0.01 query21 15.36 0.61 0.56 query22 2.57 1.98 2.49 query23 16.89 1.03 0.87 query24 2.99 0.78 1.28 query25 0.30 0.13 0.05 query26 0.53 0.14 0.14 query27 0.05 0.04 0.04 query28 11.01 1.10 1.05 query29 12.54 3.36 3.36 query30 0.24 0.07 0.05 query31 2.88 0.38 0.37 query32 3.27 0.46 0.47 query33 2.93 2.97 3.03 query34 16.90 4.38 4.42 query35 4.52 4.44 4.54 query36 0.67 0.48 0.47 query37 0.09 0.06 0.06 query38 0.04 0.04 0.03 query39 0.03 0.02 0.02 query40 0.16 0.13 0.12 query41 0.08 0.03 0.02 query42 0.03 0.02 0.02 query43 0.04 0.03 0.03 Total cold run time: 106.97 s Total hot run time: 32.49 s ```