matrixorigin / matrixone

Hyperconverged cloud-edge native database
https://docs.matrixorigin.cn/en
Apache License 2.0
1.78k stars 276 forks source link

[Subtask]: CU and resource analyze issue classify and trace #17570

Open qingxinhome opened 3 months ago

qingxinhome commented 3 months ago

Parent Issue

16063

Detail of Subtask

对目前存在的cu计费问题, anlayze资源统计异常问题进行归类和追踪

Describe implementation you've considered

No response

Additional information

No response

qingxinhome commented 3 months ago

CU 和 analzye issue分类:

1.CPU时间消耗异常: [Bug]: Cpu Time statistics value less then 0 #14926 https://github.com/matrixorigin/matrixone/issues/14926

[Bug]: tpch10g q10 q19 q11 cpu consumption stats increases much #14430 https://github.com/matrixorigin/matrixone/issues/14430

[Bug]: Resource consumption decreases for the same SQL as CN scales out #14234 https://github.com/matrixorigin/matrixone/issues/14234

[MO BUG]: 百度:SQL的执行时间和CU差距很大 #3082 https://github.com/matrixorigin/MO-Cloud/issues/3082

2. S3资源消耗异常: [Bug]: Incorrect stats in exec_plan #14107 https://github.com/matrixorigin/matrixone/issues/14107

3.整体资源消耗发生异常变化,需要整体分析: [MO BUG]:新版本 TPCH-100GB CU 消耗降低很多,需要检查其合理性 #3032 https://github.com/matrixorigin/MO-Cloud/issues/3032

[MO BUG]:dev 环境 tpch 所有sql cu值在3.29->3.30号均发生不同程度的下降 #2927 https://github.com/matrixorigin/MO-Cloud/issues/2927

[MO BUG]: 同样的语句执行时间和得到的CU差距巨大 #2903 https://github.com/matrixorigin/MO-Cloud/issues/2903

[User Bug]: MOC线上环境Baidu计费分析 #3671 https://github.com/matrixorigin/MO-Cloud/issues/3671

4. DML语句执行时,CU资源消耗差距很大 [MO BUG]: CU计算明显有问题 #3003 https://github.com/matrixorigin/MO-Cloud/issues/3003

[MO BUG]: CU算的应该有问题 #2966 https://github.com/matrixorigin/MO-Cloud/issues/2966

[MO BUG]: moc上执行一个statement_info的简单筛选要花120万 #2351 https://github.com/matrixorigin/MO-Cloud/issues/2351

5.SQL执行扫描的数据量和行数不正确: [MO BUG]: 光衡:delete扫描数据行数和数据量不对 #2983 https://github.com/matrixorigin/MO-Cloud/issues/2983

[MO BUG]: 壁达反馈:扫描数据量太多,跟总数据量对不上 #2938 https://github.com/matrixorigin/MO-Cloud/issues/2938

[MO BUG]: moc上执行一个statement_info的简单筛选要花120万 #2351 https://github.com/matrixorigin/MO-Cloud/issues/2351

6.功能和技术需求: [Tech Request]: More accurate sql resource consumption statistics #11081 https://github.com/matrixorigin/matrixone/issues/11081

[MOC SubTask] 提供一个精确测量MO中SQL执行的cpu消耗的工具 #2371 https://github.com/matrixorigin/MO-Cloud/issues/2371

[MOC SubTask] 给权限认证部分耗时加入到CPU耗时中 #2150 https://github.com/matrixorigin/MO-Cloud/issues/2150

[Feature Request]: Resource statistics when compile retry execute #18449 https://github.com/matrixorigin/matrixone/issues/18449

[Subtask]: Refactor pipeline analyze based on the physics plan reconstruction #17536 https://github.com/matrixorigin/matrixone/issues/17536

[Subtask]: Explain the pipeline information of SQL physical plan #18620 https://github.com/matrixorigin/matrixone/issues/18620

[Subtask]: Refactoring operator analyzer #17797 https://github.com/matrixorigin/matrixone/issues/17797