matrixorigin / matrixone

Hyperconverged cloud-edge native database
https://docs.matrixorigin.cn/en
Apache License 2.0
1.77k stars 274 forks source link

[Bug]: standalone tpcc 10/100 connections Communications link failure #17679

Open jiangxinmeng1 opened 2 months ago

jiangxinmeng1 commented 2 months ago

Is there an existing issue for the same bug?

Branch Name

main

Commit ID

93043522e4b646619cfcd786ea89b00ccaa65756

Other Environment Information

- Hardware parameters:
- OS type:
- Others:

Actual Behavior

跑15分钟后开始报The connection[75] has not been valid, caused by: Communications link failure,然后卡死连不上mysql

Expected Behavior

No response

Steps to Reproduce

用launch-with-proxy启动mo-service

./mo-service -launch ./etc/launch-with-proxy/launch.toml -debug-http :6060 > 1 &> store.log

跑tpcc 10 warehouses, 100 terminals,
大概15分钟后开始报错。
2f7ef3eb4c576b61b445a1c7dbe7889

goroutine2.log

jiangxinmeng1 commented 2 months ago

goroutine2.log

ouyuanning commented 2 months ago
2f7ef3eb4c576b61b445a1c7dbe7889

goroutine2.log

ouyuanning commented 2 months ago

多CN,单独跑tpcc,15分钟以上

ouyuanning commented 2 months ago

有可能跟 #17665 这个有关系

jensenojs commented 1 month ago

repro on sysbench

https://github.com/matrixorigin/matrixone/actions/runs/10448322057/job/28929680161

https://grafana.ci.matrixorigin.cn/explore?panes=%7B%225RM%22:%7B%22datasource%22:%22loki%22,%22queries%22:%5B%7B%22refId%22:%22A%22,%22expr%22:%22%7Bnamespace%3D%5C%22mo-checkin-regression-18123%5C%22%7D%20%7C%3D%20%60%60%22,%22queryType%22:%22range%22,%22datasource%22:%7B%22type%22:%22loki%22,%22uid%22:%22loki%22%7D,%22editorMode%22:%22builder%22%7D%5D,%22range%22:%7B%22from%22:%221724051230000%22,%22to%22:%221724051410000%22%7D%7D%7D&schemaVersion=1&orgId=1

reusee commented 1 month ago

无进展

reusee commented 4 weeks ago

无进展

reusee commented 3 weeks ago

无进展

reusee commented 2 weeks ago

无进展

reusee commented 2 weeks ago

无进展

reusee commented 1 week ago

无进展

reusee commented 1 week ago

无进展

reusee commented 1 day ago

无进展