apache / doris

Apache Doris is an easy-to-use, high performance and unified analytics database.
https://doris.apache.org
Apache License 2.0
11.82k stars 3.12k forks source link

[fix](cloud) Update mtime only if partitions have updated time #37055

Closed gavinchou closed 2 days ago

gavinchou commented 2 days ago

This PR fix the in-compatibility introduced by #34615

doris-robot commented 2 days ago

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website. See Doris Document.

gavinchou commented 2 days ago

run buildall

github-actions[bot] commented 2 days ago

PR approved by at least one committer and no changes requested.

github-actions[bot] commented 2 days ago

PR approved by anyone and no changes requested.

doris-robot commented 2 days ago
TPC-H: Total hot run time: 40421 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit bbf187db951ecd69199285f94378003695584984, data reload: false ------ Round 1 ---------------------------------- q1 17620 4300 4247 4247 q2 2013 201 190 190 q3 10489 1187 1201 1187 q4 10199 713 857 713 q5 7494 2668 2624 2624 q6 222 139 135 135 q7 954 604 605 604 q8 9218 2068 2030 2030 q9 8965 6467 6493 6467 q10 8879 3729 3737 3729 q11 440 225 242 225 q12 440 238 229 229 q13 17777 2984 2981 2981 q14 278 224 214 214 q15 522 478 475 475 q16 512 369 378 369 q17 945 634 691 634 q18 7892 7370 7398 7370 q19 4586 1477 1466 1466 q20 643 324 325 324 q21 4984 3875 3924 3875 q22 388 346 333 333 Total cold run time: 115460 ms Total hot run time: 40421 ms ----- Round 2, with runtime_filter_mode=off ----- q1 4380 4254 4255 4254 q2 380 264 273 264 q3 2980 2711 2787 2711 q4 2020 1746 1680 1680 q5 5635 5527 5488 5488 q6 233 129 127 127 q7 2179 1840 1875 1840 q8 3257 3341 3391 3341 q9 8694 8674 8866 8674 q10 4099 3864 3678 3678 q11 600 491 495 491 q12 842 687 655 655 q13 17132 3188 3199 3188 q14 299 270 283 270 q15 536 480 505 480 q16 503 432 425 425 q17 1813 1509 1480 1480 q18 8256 7911 7647 7647 q19 1815 1597 1548 1548 q20 2106 1866 1879 1866 q21 5065 4944 4744 4744 q22 634 573 553 553 Total cold run time: 73458 ms Total hot run time: 55404 ms ```
doris-robot commented 2 days ago
TPC-DS: Total hot run time: 172195 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit bbf187db951ecd69199285f94378003695584984, data reload: false query1 902 368 383 368 query2 6443 2424 2235 2235 query3 6627 209 222 209 query4 19008 17478 17068 17068 query5 3612 490 472 472 query6 249 182 165 165 query7 4589 291 300 291 query8 323 293 293 293 query9 8605 2389 2369 2369 query10 580 305 283 283 query11 10456 10024 9964 9964 query12 111 84 81 81 query13 1659 379 362 362 query14 9348 6647 7533 6647 query15 235 191 186 186 query16 7994 269 263 263 query17 1899 546 525 525 query18 2072 265 267 265 query19 199 153 147 147 query20 87 80 78 78 query21 210 133 131 131 query22 4328 4024 3874 3874 query23 33768 33705 33354 33354 query24 10987 2960 2865 2865 query25 614 397 362 362 query26 1140 156 154 154 query27 2317 313 321 313 query28 7302 2126 2141 2126 query29 902 607 632 607 query30 260 157 158 157 query31 1024 752 745 745 query32 98 56 55 55 query33 747 305 287 287 query34 1006 473 506 473 query35 746 663 624 624 query36 1142 1018 1000 1000 query37 146 84 78 78 query38 2959 2893 2886 2886 query39 921 849 858 849 query40 247 129 130 129 query41 54 53 52 52 query42 115 105 99 99 query43 587 533 553 533 query44 1196 733 719 719 query45 199 168 168 168 query46 1075 709 692 692 query47 1857 1780 1796 1780 query48 401 301 302 301 query49 849 409 419 409 query50 770 378 396 378 query51 6873 6675 6703 6675 query52 110 88 97 88 query53 353 291 296 291 query54 877 437 433 433 query55 73 72 71 71 query56 280 257 258 257 query57 1127 1047 1078 1047 query58 246 249 253 249 query59 3417 3192 3029 3029 query60 313 274 314 274 query61 95 93 89 89 query62 591 450 436 436 query63 312 281 285 281 query64 8742 2221 1707 1707 query65 3137 3078 3091 3078 query66 736 328 335 328 query67 15601 14954 15007 14954 query68 4524 528 526 526 query69 603 416 338 338 query70 1174 1130 1141 1130 query71 408 287 284 284 query72 6893 5209 5632 5209 query73 748 328 334 328 query74 5857 5508 5473 5473 query75 3477 2681 2660 2660 query76 2787 939 938 938 query77 640 306 330 306 query78 10325 9783 9646 9646 query79 2462 503 520 503 query80 1921 483 473 473 query81 611 216 221 216 query82 1037 108 102 102 query83 278 170 187 170 query84 252 87 84 84 query85 1096 287 270 270 query86 456 337 327 327 query87 3281 3100 3090 3090 query88 3066 2361 2361 2361 query89 472 379 383 379 query90 1737 189 187 187 query91 127 100 97 97 query92 59 49 48 48 query93 1936 503 495 495 query94 1136 190 184 184 query95 402 308 374 308 query96 587 275 266 266 query97 3201 3026 3037 3026 query98 212 198 190 190 query99 1100 823 872 823 Total cold run time: 268713 ms Total hot run time: 172195 ms ```
doris-robot commented 2 days ago
ClickBench: Total hot run time: 30.95 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit bbf187db951ecd69199285f94378003695584984, data reload: false query1 0.04 0.04 0.03 query2 0.08 0.04 0.05 query3 0.23 0.05 0.05 query4 1.69 0.08 0.07 query5 0.47 0.50 0.48 query6 1.14 0.72 0.72 query7 0.02 0.01 0.01 query8 0.05 0.04 0.04 query9 0.55 0.50 0.51 query10 0.55 0.54 0.55 query11 0.16 0.11 0.12 query12 0.15 0.12 0.12 query13 0.59 0.60 0.60 query14 0.81 0.81 0.77 query15 0.87 0.82 0.80 query16 0.36 0.37 0.37 query17 1.03 1.05 1.05 query18 0.23 0.25 0.24 query19 1.80 1.71 1.77 query20 0.01 0.02 0.01 query21 15.44 0.76 0.67 query22 3.87 7.30 2.35 query23 18.38 1.37 1.13 query24 2.15 0.22 0.21 query25 0.17 0.08 0.08 query26 0.26 0.17 0.18 query27 0.08 0.08 0.08 query28 13.26 1.02 0.99 query29 12.59 3.36 3.34 query30 0.25 0.06 0.07 query31 2.86 0.39 0.38 query32 3.27 0.48 0.47 query33 2.89 2.87 2.92 query34 17.14 4.38 4.50 query35 4.47 4.46 4.49 query36 0.64 0.47 0.49 query37 0.18 0.15 0.16 query38 0.15 0.14 0.14 query39 0.04 0.03 0.03 query40 0.19 0.14 0.14 query41 0.09 0.04 0.04 query42 0.06 0.05 0.04 query43 0.05 0.04 0.04 Total cold run time: 109.31 s Total hot run time: 30.95 s ```