StarRocks / starrocks

StarRocks, a Linux Foundation project, is a next-generation sub-second MPP OLAP database for full analytics scenarios, including multi-dimensional analytics, real-time analytics, and ad-hoc queries.
https://starrocks.io
Apache License 2.0
8.66k stars 1.75k forks source link

3.3.0存算一体更新桶出现任务完成,部分分区未完成任务 #48349

Open wangfuxu opened 2 months ago

wangfuxu commented 2 months ago

执行 alter table t_amzdb_business_report DISTRIBUTED BY HASH(UserId, AccountId, SiteCode) BUCKETS 12.

show alter table 查看结果完成。

show partations from t_amzdb_business_report 看到部分分区桶仍然是3.

show create table t_amzdb_business_report 查看表结构BUCKETS 依然是3.

查看 show load发现部分任务cancel,原因是query_timeout超时。

第二次执行alter table t_amzdb_business_report DISTRIBUTED BY HASH(UserId, AccountId, SiteCode) BUCKETS 12 全部 load任务完成,但是show create table t_amzdb_business_report 查看表结构BUCKETS 也依然是3.

总结:大表大数据量结构下执行更新表的桶结构因为按分区load query_timeout超时部分分区失败,但仍然提示成功。第二次执行全部成功后,表结构却并未更新。

当前版本:3.3.0,存算一体,存算分离均存在。

tracymacding commented 2 months ago

I think it will be fixed within https://github.com/StarRocks/starrocks/pull/48383