matrixorigin / matrixone

Hyperconverged cloud-edge native database
https://docs.matrixorigin.cn/en
Apache License 2.0
1.79k stars 277 forks source link

[Bug]: mo_cdc: drop cdc task error #19006

Closed heni02 closed 1 month ago

heni02 commented 1 month ago

Is there an existing issue for the same bug?

Branch Name

main

Commit ID

326c9fb

Other Environment Information

- Hardware parameters:
- OS type:
- Others:

Actual Behavior

创建一个cdc任务到下游mysql,日志报表不存在,之后drop该任务成功,再创建同名的cdc任务(表存在的),mo日志还是报之前的表不存在

企业微信截图_5c36ed45-774d-4081-b748-bc9c69e28cf7 企业微信截图_f60ab064-80fd-44f1-a29d-ea657f7a46c1 企业微信截图_5c36ed45-774d-4081-b748-bc9c69e28cf7

然后新创建的同步任务后下游有同步数据

企业微信截图_7a30e367-6585-4f25-9807-b5d6e9ccba6b

Expected Behavior

No response

Steps to Reproduce

创建下游表不存在的任务(下游表名是大写,上游表是小写)
./mo_cdc task create --task-name "cdc_orders" --source-uri="mysql://dump:111@10.222.6.6:6001" --sink-type="mysql" --sink-uri="mysql://dump:111@10.222.1.129:3306"    --tables='tpch_100g.orders' --level="account"  --account="sys"

./mo_cdc task pause --task-name "cdc_orders" --source-uri="mysql://dump:111@10.222.6.6:6001"

./mo_cdc task show --task-name "cdc_orders" --source-uri="mysql://dump:111@10.222.6.6:6001"

./mo_cdc task drop --task-name "cdc_orders" --source-uri="mysql://dump:111@10.222.6.6:6001"

创建下游正确的表名同步任务:
./mo_cdc task create --task-name "cdc_orders" --source-uri="mysql://dump:111@10.222.6.6:6001" --sink-type="mysql" --sink-uri="mysql://dump:111@10.222.1.129:3306"    --tables='tpch_100g.orders:tpch_100g.ORDERS' --level="account"  --account="sys"

Additional information

No response

ck89119 commented 1 month ago

找到问题原因,是删除cdc任务的时候,没有停止对下游的写入,仍在不停重试。

处理中

heni02 commented 1 month ago

confirm,closed commit:f9b8368

企业微信截图_d52ef683-60c5-4909-9c2b-bf6312dd4a93 企业微信截图_741347e0-97c4-4d15-ab91-b9205959f24d