search

pingcap / tiflow

This repo maintains DM (a data migration platform) and TiCDC (change data capture for TiDB)
Apache License 2.0
416 stars 273 forks source link

The creation time of the tidb_cdc.syncpoint_v1 table of the secondary cluster does not meet expectations #11375

Open apollodafoni opened 3 days ago

apollodafoni commented 3 days ago

What did you do?

  1. Set the syncpoint interval to 5 minutes, and complete the creation of changefeeds for three clusters at 12:32:30
  2. Primary cluster: tidb_cdc.syncpoint_v1 was created at 04:35:00
  3. Secondary cluster: created at 2024-07-02 04:45:22, and it takes 13 minutes from create changefeed to tidb_cdc.syncpoint_v1 This delay is greater than 2 syncpoint intervals
  4. The ticdc config is as follows bdr-mode = true force-replicate = true enable-sync-point = true sync-point-interval = "5m"

What did you expect to see?

The creation time of the tidb_cdc.syncpoint_v1 table of the secondary cluster within 1~2 syncpoint intervals

What did you see instead?

Versions of the cluster

ticdc git_hash 2db092244d18c043f7f8ecc85a598680b33cc324 tidb git_hash 585c631742acb338c9bd0913a89efc3efb5b884a

current status of DM cluster (execute query-status <task-name> in dmctl)

No response

apollodafoni commented 3 days ago

/assign @CharlesCheung96

apollodafoni commented 3 days ago

/severity major

apollodafoni commented 3 days ago

/area ticdc

apollodafoni commented 3 days ago

/remove-area dm

apollodafoni commented 3 days ago

/label affects-8.2.0

ti-chi-bot[bot] commented 3 days ago

@apollodafoni: The label(s) affects-8.2.0 cannot be applied. These labels are supported: duplicate, bug-from-internal-test, bug-from-user, ok-to-test, needs-ok-to-test, affects-5.4, affects-6.1, affects-6.5, affects-7.1, affects-7.5, affects-8.1, affects-8.2, may-affects-5.4, may-affects-6.1, may-affects-6.5, may-affects-7.1, may-affects-7.5, may-affects-8.1, needs-cherry-pick-release-5.4, needs-cherry-pick-release-6.1, needs-cherry-pick-release-6.5, needs-cherry-pick-release-7.1, needs-cherry-pick-release-7.5, needs-cherry-pick-release-8.1, needs-cherry-pick-release-8.2, question, release-blocker, wontfix, MariaDB.

In response to [this](https://github.com/pingcap/tiflow/issues/11375#issuecomment-2202356560): >/label affects-8.2.0 Instructions for interacting with me using PR comments are available [here](https://prow.tidb.net/command-help). If you have questions or suggestions related to my behavior, please file an issue against the [ti-community-infra/tichi](https://github.com/ti-community-infra/tichi/issues/new?title=Prow%20issue:) repository.
apollodafoni commented 3 days ago

/label affects-8.2

CharlesCheung96 commented 3 days ago 
[2024/07/02 04:40:08.276 +00:00] [ERROR] [changefeed.go:325] ["an error occurred in Owner"] [namespace=default] [changefeed=cluster-a-cluster-b] [error="[CDC:ErrMySQLTxnError]MySQL txn error: failed to create syncpoint table;: Error 8263 (HY000): The operation is not allowed while the bdr role of this cluster is set to secondary."]

The root cause is that ticdc did not set write source when creating syncpoint table.