databendlabs / databend

𝗗𝗮𝘁𝗮, 𝗔𝗻𝗮𝗹𝘆𝘁𝗶𝗰𝘀 & 𝗔𝗜. Modern alternative to Snowflake. Cost-effective and simple for massive-scale analytics. https://databend.com
https://docs.databend.com
Other
7.77k stars 741 forks source link

Feature: Support dynamic cluster #16618

Open zhang2014 opened 1 day ago

zhang2014 commented 1 day ago

Summary

When starting databend-query with ./databend-query --dynamic-cluster -c ./databend-query.toml, databend-query will be added to the resource pool of the corresponding tenant and reject all SQL requests except for CREATE DYNAMIC CLUSTER, DROP DYNAMIC CLUSTER, and SHOW DYNAMIC CLUSTERS.

When a user executes CREATE DYNAMIC CLUSTER xx WITH NODES = XX, it will obtain the corresponding number of nodes from the tenant's resource pool to form a new cluster.

When a user executes DROP DYNAMIC CLUSTER xx, all nodes of the corresponding cluster will be destroyed and returned to the tenant's resource pool.

zhang2014 commented 23 hours ago

Dynamic clusters and non-dynamic clusters cannot form the same cluster.