search

apache / doris

Apache Doris is an easy-to-use, high performance and unified analytics database.
https://doris.apache.org
Apache License 2.0
12.38k stars 3.22k forks source link

[spill](regression test) check spill temporary files are deleted after all cases are done #37248

Closed jacktengg closed 3 months ago

jacktengg commented 3 months ago

Proposed changes

Issue Number: close #xxx

doris-robot commented 3 months ago

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website. See Doris Document.

jacktengg commented 3 months ago

run buildall

github-actions[bot] commented 3 months ago

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] commented 3 months ago

clang-tidy review says "All clean, LGTM! :+1:"

doris-robot commented 3 months ago
TPC-H: Total hot run time: 39923 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 1771df88822094b409177075823cdd9ed215a9cc, data reload: false ------ Round 1 ---------------------------------- q1 17643 4437 4343 4343 q2 2015 200 206 200 q3 10423 1199 1024 1024 q4 10171 746 730 730 q5 7487 2662 2670 2662 q6 223 138 135 135 q7 961 604 604 604 q8 9242 2083 2053 2053 q9 9010 6488 6508 6488 q10 9008 3693 3746 3693 q11 448 240 239 239 q12 509 234 230 230 q13 18979 2999 2978 2978 q14 278 229 222 222 q15 524 486 488 486 q16 526 383 379 379 q17 964 686 700 686 q18 7918 7488 7341 7341 q19 3848 1538 1538 1538 q20 646 317 335 317 q21 4944 3799 3242 3242 q22 390 333 338 333 Total cold run time: 116157 ms Total hot run time: 39923 ms ----- Round 2, with runtime_filter_mode=off ----- q1 4333 4218 4249 4218 q2 384 269 268 268 q3 2978 2789 2902 2789 q4 1993 1699 1671 1671 q5 5659 5537 5487 5487 q6 224 131 127 127 q7 2197 1803 1857 1803 q8 3271 3413 3425 3413 q9 8737 8674 8857 8674 q10 4046 3921 3756 3756 q11 591 490 487 487 q12 809 651 656 651 q13 16631 3191 3189 3189 q14 323 289 280 280 q15 533 493 469 469 q16 483 446 439 439 q17 1802 1575 1513 1513 q18 8130 8162 7910 7910 q19 1821 1672 1455 1455 q20 2141 1884 1860 1860 q21 5114 4836 4648 4648 q22 658 560 534 534 Total cold run time: 72858 ms Total hot run time: 55641 ms ```
doris-robot commented 3 months ago
TPC-DS: Total hot run time: 173739 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 1771df88822094b409177075823cdd9ed215a9cc, data reload: false query1 915 382 376 376 query2 6440 2360 2300 2300 query3 6636 207 215 207 query4 19462 17542 17392 17392 query5 3574 483 477 477 query6 250 170 166 166 query7 4595 301 285 285 query8 299 297 270 270 query9 8617 2473 2459 2459 query10 610 302 284 284 query11 10601 10055 10053 10053 query12 120 92 85 85 query13 1663 376 365 365 query14 10349 7689 7570 7570 query15 228 182 184 182 query16 7737 299 318 299 query17 1809 539 524 524 query18 1945 274 272 272 query19 195 144 150 144 query20 93 80 80 80 query21 206 125 125 125 query22 4415 4004 4022 4004 query23 33892 33776 33832 33776 query24 10845 2893 2865 2865 query25 586 376 386 376 query26 724 156 156 156 query27 2273 328 326 326 query28 5903 2201 2201 2201 query29 888 649 639 639 query30 245 165 159 159 query31 1002 763 774 763 query32 94 52 54 52 query33 716 288 283 283 query34 898 474 491 474 query35 735 629 657 629 query36 1156 993 985 985 query37 141 80 79 79 query38 2985 2842 2843 2842 query39 895 879 802 802 query40 214 139 125 125 query41 55 52 51 51 query42 116 108 103 103 query43 574 549 535 535 query44 1124 761 738 738 query45 198 172 171 171 query46 1084 720 724 720 query47 1839 1782 1781 1781 query48 372 306 295 295 query49 846 408 409 408 query50 772 382 391 382 query51 6942 6907 6808 6808 query52 101 94 91 91 query53 363 292 299 292 query54 875 444 436 436 query55 76 74 72 72 query56 282 257 261 257 query57 1118 1033 1017 1017 query58 245 273 249 249 query59 3317 3248 2900 2900 query60 291 289 289 289 query61 94 88 93 88 query62 603 450 435 435 query63 325 290 282 282 query64 8527 2211 1729 1729 query65 3142 3081 3141 3081 query66 738 328 325 325 query67 15436 15001 14927 14927 query68 4506 529 531 529 query69 458 309 294 294 query70 1207 1128 1166 1128 query71 386 277 277 277 query72 7066 5307 5382 5307 query73 726 322 322 322 query74 5924 5571 5646 5571 query75 3426 2701 2714 2701 query76 2584 904 882 882 query77 436 299 300 299 query78 9498 9088 8871 8871 query79 2445 515 527 515 query80 2371 486 465 465 query81 567 217 218 217 query82 806 107 104 104 query83 295 162 165 162 query84 272 89 86 86 query85 2037 270 266 266 query86 496 335 332 332 query87 3291 3189 3076 3076 query88 4294 2368 2380 2368 query89 491 377 394 377 query90 1792 189 184 184 query91 131 99 102 99 query92 60 50 50 50 query93 2298 515 499 499 query94 1102 208 208 208 query95 408 316 332 316 query96 581 273 351 273 query97 3173 3013 3083 3013 query98 221 194 201 194 query99 1270 841 845 841 Total cold run time: 269024 ms Total hot run time: 173739 ms ```
doris-robot commented 3 months ago
ClickBench: Total hot run time: 31.28 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 1771df88822094b409177075823cdd9ed215a9cc, data reload: false query1 0.04 0.03 0.03 query2 0.08 0.04 0.04 query3 0.22 0.06 0.05 query4 1.69 0.08 0.10 query5 0.51 0.48 0.49 query6 1.14 0.72 0.74 query7 0.02 0.01 0.01 query8 0.05 0.05 0.05 query9 0.55 0.50 0.50 query10 0.55 0.54 0.53 query11 0.16 0.12 0.11 query12 0.15 0.13 0.13 query13 0.60 0.59 0.58 query14 0.78 0.79 0.75 query15 0.86 0.80 0.81 query16 0.38 0.36 0.37 query17 1.00 1.02 0.99 query18 0.22 0.25 0.26 query19 1.91 1.71 1.68 query20 0.02 0.01 0.01 query21 15.39 0.76 0.65 query22 4.13 6.79 2.42 query23 18.32 1.38 1.32 query24 2.15 0.23 0.23 query25 0.16 0.08 0.09 query26 0.26 0.18 0.17 query27 0.09 0.08 0.08 query28 13.24 1.01 0.99 query29 12.59 3.39 3.37 query30 0.25 0.07 0.05 query31 2.88 0.39 0.39 query32 3.26 0.48 0.47 query33 2.92 2.96 2.97 query34 16.98 4.43 4.47 query35 4.53 4.45 4.55 query36 0.66 0.46 0.47 query37 0.19 0.16 0.16 query38 0.16 0.16 0.15 query39 0.05 0.04 0.04 query40 0.16 0.14 0.16 query41 0.10 0.04 0.05 query42 0.06 0.05 0.04 query43 0.04 0.04 0.04 Total cold run time: 109.5 s Total hot run time: 31.28 s ```
jacktengg commented 3 months ago

run p0

github-actions[bot] commented 3 months ago

PR approved by at least one committer and no changes requested.

github-actions[bot] commented 3 months ago

PR approved by anyone and no changes requested.