search

apache / doris

Apache Doris is an easy-to-use, high performance and unified analytics database.
https://doris.apache.org
Apache License 2.0
11.8k stars 3.11k forks source link

[fix](jdbc catalog) fix jdbc table sink writer close nullptr and add log #37021

Closed zy-kkk closed 14 hours ago

zy-kkk commented 3 days ago

fix jdbc table sink writer close nullptr and add log

doris-robot commented 3 days ago

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website. See Doris Document.

zy-kkk commented 3 days ago

run buildall

github-actions[bot] commented 3 days ago

PR approved by at least one committer and no changes requested.

github-actions[bot] commented 3 days ago

PR approved by anyone and no changes requested.

github-actions[bot] commented 3 days ago

clang-tidy review says "All clean, LGTM! :+1:"

doris-robot commented 3 days ago
TPC-H: Total hot run time: 50692 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools Tpch sf100 test result on commit 910739c4578fb85b81031c674e29ff3fbbb43ccb, data reload: false ------ Round 1 ---------------------------------- q1 18146 4433 4381 4381 q2 2148 156 149 149 q3 10272 1939 2001 1939 q4 10116 1270 1500 1270 q5 8498 4049 3928 3928 q6 232 150 143 143 q7 2038 1599 1618 1599 q8 9527 2768 2724 2724 q9 14174 10815 10664 10664 q10 8655 3609 3616 3609 q11 424 239 251 239 q12 479 310 312 310 q13 18392 3976 4030 3976 q14 354 327 328 327 q15 531 468 475 468 q16 688 578 589 578 q17 1154 948 904 904 q18 7316 6967 7034 6967 q19 1784 1634 1639 1634 q20 531 308 307 307 q21 4438 4148 4138 4138 q22 528 438 450 438 Total cold run time: 120425 ms Total hot run time: 50692 ms ----- Round 2, with runtime_filter_mode=off ----- q1 4344 4329 4303 4303 q2 320 241 223 223 q3 4166 4165 4204 4165 q4 2761 2747 2773 2747 q5 7277 7205 7186 7186 q6 239 117 121 117 q7 3220 2898 2858 2858 q8 4370 4462 4498 4462 q9 17465 17162 17261 17162 q10 4223 4310 4322 4310 q11 749 693 683 683 q12 1035 866 857 857 q13 6826 3761 3753 3753 q14 455 426 423 423 q15 500 459 464 459 q16 736 677 675 675 q17 3902 3818 4067 3818 q18 8764 8878 8709 8709 q19 1775 1680 1667 1667 q20 2416 2124 2088 2088 q21 8500 8598 8487 8487 q22 1078 948 1014 948 Total cold run time: 85121 ms Total hot run time: 80100 ms ```
doris-robot commented 3 days ago

TeamCity be ut coverage result: Function Coverage: 37.89% (8114/21417) Line Coverage: 29.55% (66435/224854) Region Coverage: 29.01% (34236/118003) Branch Coverage: 24.87% (17571/70652) Coverage Report: http://coverage.selectdb-in.cc/coverage/910739c4578fb85b81031c674e29ff3fbbb43ccb_910739c4578fb85b81031c674e29ff3fbbb43ccb/report/index.html

doris-robot commented 3 days ago
TPC-DS: Total hot run time: 203722 ms ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools TPC-DS sf100 test result on commit 910739c4578fb85b81031c674e29ff3fbbb43ccb, data reload: false query1 960 430 389 389 query2 6553 2877 2857 2857 query3 6923 206 207 206 query4 20584 17994 17990 17990 query5 19737 6556 6466 6466 query6 282 222 222 222 query7 4159 300 315 300 query8 421 423 431 423 query9 3131 2685 2642 2642 query10 409 312 331 312 query11 11395 10725 10892 10725 query12 122 83 76 76 query13 5608 692 686 686 query14 18406 13412 13295 13295 query15 360 240 242 240 query16 6484 291 270 270 query17 1721 1461 901 901 query18 2291 416 407 407 query19 206 147 152 147 query20 80 82 80 80 query21 190 96 96 96 query22 5228 5093 5137 5093 query23 32698 32195 32193 32193 query24 6916 6513 6522 6513 query25 525 426 424 424 query26 526 165 161 161 query27 1886 293 301 293 query28 6137 2382 2330 2330 query29 2915 2730 2844 2730 query30 242 162 168 162 query31 924 748 740 740 query32 69 67 63 63 query33 406 254 254 254 query34 859 461 481 461 query35 1153 951 958 951 query36 1314 1134 1208 1134 query37 94 60 63 60 query38 3099 2934 2950 2934 query39 1379 1331 1335 1331 query40 210 93 94 93 query41 46 44 42 42 query42 86 84 82 82 query43 788 721 649 649 query44 1119 711 719 711 query45 255 239 239 239 query46 1237 935 990 935 query47 1850 1761 1674 1674 query48 996 706 693 693 query49 614 380 384 380 query50 862 609 606 606 query51 4779 4684 4727 4684 query52 94 87 78 78 query53 448 328 317 317 query54 2654 2413 2467 2413 query55 94 76 79 76 query56 247 209 218 209 query57 1193 1113 1144 1113 query58 223 202 213 202 query59 4120 3891 3897 3891 query60 215 210 193 193 query61 107 102 110 102 query62 860 525 441 441 query63 486 340 341 340 query64 2530 1576 1502 1502 query65 3644 3530 3550 3530 query66 795 377 391 377 query67 15800 15025 14815 14815 query68 9926 671 668 668 query69 565 351 355 351 query70 1728 1537 1300 1300 query71 400 301 319 301 query72 6602 3528 3553 3528 query73 728 318 314 314 query74 6330 5978 5872 5872 query75 5259 3695 3679 3679 query76 6364 1112 1150 1112 query77 1091 262 247 247 query78 13072 12130 11670 11670 query79 11362 635 655 635 query80 1551 398 413 398 query81 492 239 235 235 query82 1588 100 95 95 query83 168 135 130 130 query84 259 71 71 71 query85 880 326 332 326 query86 321 281 292 281 query87 3263 3024 3037 3024 query88 5022 2318 2312 2312 query89 470 305 276 276 query90 1949 216 195 195 query91 175 141 141 141 query92 56 54 51 51 query93 6941 552 575 552 query94 751 218 212 212 query95 1125 1062 1050 1050 query96 653 326 316 316 query97 6567 6464 6455 6455 query98 180 179 167 167 query99 3074 937 814 814 Total cold run time: 321656 ms Total hot run time: 203722 ms ```
doris-robot commented 3 days ago
ClickBench: Total hot run time: 30.65 s ``` machine: 'aliyun_ecs.c7a.8xlarge_32C64G' scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools ClickBench test result on commit 910739c4578fb85b81031c674e29ff3fbbb43ccb, data reload: false query1 0.02 0.02 0.02 query2 0.07 0.02 0.02 query3 0.25 0.05 0.05 query4 1.79 0.10 0.08 query5 0.54 0.53 0.52 query6 1.24 0.63 0.62 query7 0.01 0.01 0.01 query8 0.03 0.03 0.02 query9 0.52 0.49 0.48 query10 0.54 0.53 0.53 query11 0.12 0.08 0.09 query12 0.11 0.09 0.10 query13 0.64 0.61 0.61 query14 0.79 0.77 0.78 query15 0.79 0.77 0.77 query16 0.39 0.36 0.38 query17 1.02 1.02 1.04 query18 0.22 0.23 0.25 query19 1.94 1.80 1.85 query20 0.01 0.00 0.01 query21 15.47 0.56 0.54 query22 2.05 2.36 1.47 query23 16.76 1.09 0.88 query24 6.02 1.06 1.55 query25 0.39 0.10 0.05 query26 0.66 0.15 0.15 query27 0.05 0.04 0.04 query28 6.72 0.79 0.71 query29 12.70 2.34 2.33 query30 0.59 0.53 0.51 query31 2.81 0.39 0.37 query32 3.38 0.50 0.49 query33 3.11 3.04 3.04 query34 15.25 4.83 4.82 query35 4.89 4.87 4.86 query36 1.04 1.01 1.02 query37 0.06 0.04 0.04 query38 0.04 0.02 0.03 query39 0.02 0.02 0.01 query40 0.16 0.15 0.14 query41 0.06 0.02 0.01 query42 0.02 0.01 0.02 query43 0.03 0.02 0.01 Total cold run time: 103.32 s Total hot run time: 30.65 s ```
doris-robot commented 3 days ago

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 910739c4578fb85b81031c674e29ff3fbbb43ccb with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.9 seconds inserted 10000000 Rows, about 456K ops/s