[Bug]: [date 6.5]standalone regression: sysbench 100w cluster by table select point test mo oom

heni02 commented 5 months ago

Is there an existing issue for the same bug?

[X] I have checked the existing issues.

Branch Name

main

Commit ID

18fa04053a9a9566af9b30a6277a483327cd8a1d

Other Environment Information

- Hardware parameters:
- OS type:
- Others:

Actual Behavior

job:https://github.com/matrixorigin/mo-nightly-regression/actions/runs/9386897563/job/25848743641

企业微信截图_9fe0f988-fce6-4d04-a22a-561238beaa50

oom kill时间：06:30:28

企业微信截图_758f31e5-8dc5-4b56-b9ce-0094d5d7e108

该测试开始之前的内存也很高

企业微信截图_3d2df88a-fbae-4035-b5bd-eeb70a5dd822

单独执行该场景测试没有oom

企业微信截图_5a3d1c5e-d1f5-4152-85af-472dfa3062a2

profile: cluster_by_oom_main.zip

gc log: clusterby_gclog.log

Expected Behavior

No response

Steps to Reproduce

sysbench  --mysql-host=127.0.0.1 --mysql-port=6001 --mysql-user=dump --mysql-*** oltp_point_select.lua --mysql-db=sysbench_db --tables=10 --table_size=1000000 --threads=100 --time=30 --report-interval=10 --secondary=on  --create_secondary=off --auto_inc=off prepare
for i in {1..10};do mysql -h 127.0.0.1 -P6001 -udump -p111 -e "alter table sysbench_db.sbtest$i rename to sysbench_db.bak_sbtest$i;create table sysbench_db.sbtest$i(id int not null,k int default 0,c char(120) default '',pad char(60) default '')cluster by(id);insert into sysbench_db.sbtest$i select * from sysbench_db.bak_sbtest$i;drop table sysbench_db.bak_sbtest$i";done
sysbench --mysql-host=127.0.0.1 --mysql-port=6001 --mysql-user=dump --mysql-***  oltp_point_select.lua --mysql-db=sysbench_db --tables=10 --table_size=1000000 --threads=100 --time=300 --report-interval=10 --range_selects=off --point_selects=1 --secondary=on  --create_secondary=off --auto_inc=off run

Additional information

No response

heni02 commented 5 months ago

cluster by表ddl： CREATE TABLE sbtest8 ( id INT NOT NULL, k INT DEFAULT 0, c CHAR(120) DEFAULT '', pad CHAR(60) DEFAULT '' ) CLUSTER BY (id)

YANGGMM commented 5 months ago

@ouyuanning 麻烦看一下

ouyuanning commented 5 months ago

倪涛有空帮忙看看吧

badboynt1 commented 5 months ago

issue里说了，执行该测试之前的内存已经很高了，并且单独执行该测试不会oom。那说明oom跟这个没有关系啊，分析这个case没有用啊

badboynt1 commented 5 months ago

sysbench相关的oom问题，有一些其他的issue在跟踪，例如https://github.com/matrixorigin/matrixone/issues/16659

当前case没有实际意义，先关掉

heni02 commented 4 months ago

oom问题统一等待处理，先降级s1

matrixorigin / matrixone