pingcap / tiflash

The analytical engine for TiDB and TiDB Cloud. Try free: https://tidbcloud.com/free-trial
https://docs.pingcap.com/tidb/stable/tiflash-overview
Apache License 2.0
941 stars 409 forks source link

Read Thread Pool Enhancement #6834

Open JinheLin opened 1 year ago

flowbehappy commented 1 year ago

Background of this task: Currently, small queries (e.g. scan 2 million rows and do aggregation) can not fully use CPU resources on 8 logical core machines (e.g. r5.2xlarge).

Also, consider making the default thread pool size to be 2x of CPU number. And check whether it is more efficient for small queries.