search

apache / doris

Apache Doris is an easy-to-use, high performance and unified analytics database.
https://doris.apache.org
Apache License 2.0
12.77k stars 3.29k forks source link

[improve](routine load) adjust default values to make routine load more convenient to use (#42491) #44377

Closed sollhui closed 13 hours ago

sollhui commented 1 day ago

pick (#42491)

For a routine load job, it will be divided into many tasks, each of which is a transaction. Currently, the default time consumed(max_batch_interval) is 10 seconds. The benefits of increasing this value are:

  1. Larger batch consumption can lead to better performance.
  2. Reducing the number of transactions can alleviate the pressure of compaction and the conflicts of concurrent transaction submissions.

related doc: https://github.com/apache/doris-website/pull/1236/files

doris-robot commented 1 day ago

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?
sollhui commented 1 day ago

run buildall

github-actions[bot] commented 1 day ago

clang-tidy review says "All clean, LGTM! :+1:"

doris-robot commented 23 hours ago

TeamCity be ut coverage result: Function Coverage: 36.45% (9519/26113) Line Coverage: 27.93% (78333/280433) Region Coverage: 26.59% (40175/151096) Branch Coverage: 23.39% (20397/87220) Coverage Report: http://coverage.selectdb-in.cc/coverage/85c1bdfcd708236e3617bebaf58ca29dd3bd6c2f_85c1bdfcd708236e3617bebaf58ca29dd3bd6c2f/report/index.html