search

apache / doris

Apache Doris is an easy-to-use, high performance and unified analytics database.
https://doris.apache.org
Apache License 2.0
11.82k stars 3.12k forks source link

[fix](nereids) ColStatsMeta.partitionUpdateRows npe #37044

Closed englefly closed 2 days ago

englefly commented 2 days ago

when fe upgraded from old version, colMeta object may be deserialized from json,and colMeta.partitionUpdateRows could be null

Proposed changes

Issue Number: close #xxx

doris-robot commented 2 days ago

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website. See Doris Document.

englefly commented 2 days ago

run buildall

doris-robot commented 2 days ago
TPC-H: Total hot run time: 39248 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 52ad9f527cbff150db96a26ddfdc46b1e1d41e15, data reload: false ------ Round 1 ---------------------------------- q1 17639 4245 4243 4243 q2 2019 211 203 203 q3 10420 1204 1020 1020 q4 10201 757 666 666 q5 7492 2674 2598 2598 q6 222 141 140 140 q7 960 591 601 591 q8 9242 2074 2047 2047 q9 8901 6451 6467 6451 q10 8865 3678 3653 3653 q11 451 233 232 232 q12 495 234 234 234 q13 18911 2945 2972 2945 q14 275 223 223 223 q15 524 497 480 480 q16 515 374 375 374 q17 958 679 734 679 q18 7912 7401 7315 7315 q19 6846 1509 1382 1382 q20 659 328 342 328 q21 4917 3117 3890 3117 q22 381 327 337 327 Total cold run time: 118805 ms Total hot run time: 39248 ms ----- Round 2, with runtime_filter_mode=off ----- q1 4333 4204 4241 4204 q2 373 267 259 259 q3 2944 2882 2884 2882 q4 1956 1656 1763 1656 q5 5546 5489 5489 5489 q6 222 132 132 132 q7 2195 1851 1862 1851 q8 3236 3388 3446 3388 q9 8740 8732 8796 8732 q10 4086 3850 3713 3713 q11 575 499 488 488 q12 819 657 650 650 q13 15760 3138 3156 3138 q14 304 286 259 259 q15 527 489 511 489 q16 502 424 432 424 q17 1827 1521 1504 1504 q18 8102 7943 7735 7735 q19 1743 1615 1542 1542 q20 2154 1921 1882 1882 q21 5096 4893 4894 4893 q22 634 556 540 540 Total cold run time: 71674 ms Total hot run time: 55850 ms ```
doris-robot commented 2 days ago
TPC-DS: Total hot run time: 173644 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 52ad9f527cbff150db96a26ddfdc46b1e1d41e15, data reload: false query1 921 387 368 368 query2 6456 2371 2321 2321 query3 6637 213 219 213 query4 20157 17511 17260 17260 query5 3624 481 486 481 query6 270 204 175 175 query7 4595 299 288 288 query8 316 285 303 285 query9 8453 2382 2368 2368 query10 597 329 293 293 query11 10534 9988 9959 9959 query12 110 80 80 80 query13 1631 362 360 360 query14 9289 7486 7505 7486 query15 233 181 187 181 query16 7727 276 261 261 query17 1888 537 518 518 query18 1930 264 264 264 query19 188 149 147 147 query20 90 83 80 80 query21 207 137 128 128 query22 4357 4058 3973 3973 query23 33801 33657 33535 33535 query24 10933 2828 2954 2828 query25 588 379 363 363 query26 711 150 147 147 query27 2257 317 330 317 query28 6074 2133 2145 2133 query29 885 635 634 634 query30 259 155 161 155 query31 989 760 764 760 query32 94 52 57 52 query33 653 293 286 286 query34 862 464 504 464 query35 762 628 629 628 query36 1150 975 985 975 query37 140 76 92 76 query38 2895 2878 2851 2851 query39 867 827 833 827 query40 209 125 129 125 query41 54 51 51 51 query42 108 105 101 101 query43 599 550 553 550 query44 1101 738 724 724 query45 184 188 165 165 query46 1068 738 731 731 query47 1855 1748 1768 1748 query48 374 295 289 289 query49 840 412 408 408 query50 770 389 382 382 query51 6829 6646 6834 6646 query52 98 90 90 90 query53 363 288 289 288 query54 891 442 440 440 query55 81 76 72 72 query56 291 265 264 264 query57 1114 1052 1070 1052 query58 259 232 258 232 query59 3367 3252 2959 2959 query60 296 271 277 271 query61 94 97 110 97 query62 614 447 441 441 query63 315 290 288 288 query64 8600 2356 1870 1870 query65 3488 3100 3120 3100 query66 759 330 338 330 query67 15356 15206 14946 14946 query68 4843 543 554 543 query69 724 486 333 333 query70 1238 1112 1127 1112 query71 454 284 283 283 query72 8812 5783 5288 5288 query73 760 330 328 328 query74 5937 5575 5466 5466 query75 4252 2679 2640 2640 query76 3456 994 891 891 query77 664 302 305 302 query78 11704 10276 9681 9681 query79 4630 513 508 508 query80 1038 464 462 462 query81 549 218 224 218 query82 757 112 100 100 query83 349 174 169 169 query84 265 89 82 82 query85 705 281 282 281 query86 467 326 319 319 query87 3305 3095 3072 3072 query88 4516 2385 2347 2347 query89 480 380 376 376 query90 1850 185 188 185 query91 127 98 100 98 query92 62 48 50 48 query93 3764 508 506 506 query94 1141 193 186 186 query95 420 309 305 305 query96 610 264 273 264 query97 3218 3017 3058 3017 query98 214 203 194 194 query99 1151 860 862 860 Total cold run time: 276569 ms Total hot run time: 173644 ms ```
doris-robot commented 2 days ago
ClickBench: Total hot run time: 30.7 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 52ad9f527cbff150db96a26ddfdc46b1e1d41e15, data reload: false query1 0.04 0.03 0.03 query2 0.07 0.04 0.03 query3 0.22 0.05 0.05 query4 1.66 0.08 0.07 query5 0.48 0.49 0.50 query6 1.13 0.72 0.71 query7 0.02 0.01 0.01 query8 0.05 0.04 0.04 query9 0.55 0.50 0.50 query10 0.54 0.53 0.53 query11 0.15 0.11 0.12 query12 0.14 0.12 0.12 query13 0.59 0.60 0.59 query14 0.76 0.78 0.80 query15 0.85 0.81 0.81 query16 0.35 0.36 0.35 query17 0.95 1.02 0.92 query18 0.22 0.24 0.26 query19 1.81 1.73 1.67 query20 0.01 0.01 0.01 query21 15.44 0.75 0.66 query22 3.97 7.30 2.13 query23 18.34 1.36 1.34 query24 2.10 0.24 0.22 query25 0.15 0.08 0.09 query26 0.28 0.17 0.18 query27 0.08 0.09 0.08 query28 13.27 1.03 0.98 query29 12.65 3.25 3.25 query30 0.26 0.06 0.07 query31 2.87 0.38 0.38 query32 3.29 0.47 0.48 query33 2.88 2.90 2.87 query34 17.18 4.46 4.48 query35 4.51 4.58 4.45 query36 0.66 0.46 0.46 query37 0.19 0.15 0.15 query38 0.14 0.14 0.14 query39 0.05 0.03 0.03 query40 0.17 0.15 0.14 query41 0.09 0.05 0.04 query42 0.05 0.05 0.04 query43 0.04 0.04 0.04 Total cold run time: 109.25 s Total hot run time: 30.7 s ```
englefly commented 2 days ago

run external

github-actions[bot] commented 2 days ago

PR approved by at least one committer and no changes requested.

github-actions[bot] commented 2 days ago

PR approved by anyone and no changes requested.