actiontech / dtle

Distributed Data Transfer Service for MySQL
https://actiontech.github.io/dtle-docs-cn
Mozilla Public License 2.0
551 stars 133 forks source link

mysql incr job - send ignore table dml to the dest mysql #799

Closed asiroliu closed 3 years ago

asiroliu commented 3 years ago

Description

mysql incr job - send ignore table dml to the dest mysql

Steps to reproduce the issue

  1. create dtle job
    "replicate_do_db": [],
    "replicate_ignore_db": [
      {
        "table_schema": "action_db_1",
        "tables": [
          {
            "table_name": "sbtest1"
          },
          {
            "table_name": "sbtest2"
          }
        ]
      }
    ]
  2. create tables sbtest1/sbtest2/sbtest3
    sysbench /usr/share/sysbench/oltp_insert.lua --mysql-host=172.100.9.2 --mysql-port=3306 --mysql-user=test --mysql-password=test --create_secondary=off --report-interval=10 --time=0 --mysql-db=action_db_1 --tables=3 --table_size=0 prepare
  3. insert data to sbtest1
    sysbench /usr/share/sysbench/oltp_insert.lua --mysql-host=172.100.9.1 --mysql-port=3306 --mysql-user=test --mysql-password=test --create_secondary=off --report-interval=10 --mysql-db=action_db_1 --tables=1 --events=1 run
  4. dtle job failed
    # dest dtle log
    2021-11-02T13:30:35.967+0800 [DEBUG] client.driver_mgr.dtle: : driver=dtle job=repl_instance_and_ignore_n_databases_n_tables-migration @module=dtle.applier timestamp=2021-11-02T13:30:35.967+0800
    2021-11-02T13:30:35.967+0800 [ERROR] client.driver_mgr.dtle: GetTableColumns. action_db_1 sbtest1: Error 1146: Table 'action_db_1.sbtest1' doesn't exist: driver=dtle @module=dtle.applier job=repl_instance_and_ignore_n_databases_n_tables-migration timestamp=2021-11-02T13:30:35.967+0800
    2021-11-02T13:30:35.967+0800 [ERROR] client.driver_mgr.dtle: onError: driver=dtle @module=dtle.applier err="GetTableColumns. action_db_1 sbtest1: Error 1146: Table 'action_db_1.sbtest1' doesn't exist" job=repl_instance_and_ignore_n_databases_n_tables-migration timestamp=2021-11-02T13:30:35.967+0800
    2021-11-02T13:30:35.967+0800 [DEBUG] client.driver_mgr.dtle: onError. nats published: driver=dtle @module=dtle.applier job=repl_instance_and_ignore_n_databases_n_tables-migration timestamp=2021-11-02T13:30:35.967+0800

Output of ./dtle version:**

9.9.9.9-master-ef8ac77
asiroliu commented 3 years ago

verfiied : http://gocd-server:8153/go/pipelines/autotest-dtle-master/153/test/1