pingcap / br

A command-line tool for distributed backup and restoration of the TiDB cluster data
https://pingcap.com/docs/dev/how-to/maintain/backup-and-restore/br/
Apache License 2.0
124 stars 102 forks source link

The BR cdc incremental recovery operation will not be recorded in cdclog. #869

Open tongtongyin opened 3 years ago

tongtongyin commented 3 years ago

Please answer these questions before submitting your issue. Thanks!

  1. What did you do? If possible, provide a recipe for reproducing the error. Turn on cdc synchronization, perform a full backup A, and then insert some data into the instance. Then perform BR incremental recovery twice in succession, then the second BR incremental recovery will have the problem of inconsistency with the data required by the user. Because BR incremental recovery operations will not be recorded in the cdclog.

  2. What did you expect to see? After cdc synchronization is enabled, when BR incremental recovery is performed, the operation of BR incremental recovery can be recorded in cdclog.

  3. What did you see instead?

  4. What version of BR and TiDB/TiKV/PD are you using?

  1. Operation logs

    • Please upload br.log for BR if possible
    • Please upload tidb-lightning.log for TiDB-Lightning if possible
    • Please upload tikv-importer.log from TiKV-Importer if possible
    • Other interesting logs
  2. Configuration of the cluster and the task

    • tidb-lightning.toml for TiDB-Lightning if possible
    • tikv-importer.toml for TiKV-Importer if possible
    • topology.yml if deployed by TiUP
  3. Screenshot/exported-PDF of Grafana dashboard or metrics' graph in Prometheus if possible

IANTHEREAL commented 3 years ago

Do you have two tidb clusters A and B, have you performed the following sequence of operations?

  1. Start TiCDC of cluster A to copy data to cluster B
  2. A cluster performs full backup
  3. Insert some data in cluster A
  4. Restore the full backup data of step 2 in cluster B
  5. Perform incremental data recovery in cluster B (when was this incremental recovery data backed up from cluster A)
cyliu0 commented 3 years ago

According to What should I do when BR restores data to the upstream cluster of TiCDC/Drainer?, operations like is not supported yet.