moiot / gravity

A Data Replication Center
Apache License 2.0
912 stars 173 forks source link

启用delete-dml-column filter的时候,在initTableDDL的时候会报错 #318

Closed zeusYi closed 3 years ago

zeusYi commented 3 years ago

配置文件

    "name": "fdasfasfasdf",
    "internal-db-name": "_gravity",
    "input": {
        "type": "mysql",
        "mode": "replication",
        "config": {
            "batch-per-second-limit": 2,
            "max-full-dump-count": 1000000,
            "nr-scanner": 4,
            "table-scan-batch": 10000,
            "source": {
                "host": "192.168.184.34",
                "port": 38375,
                "username": "root",
                "password": "root123",
                "timeout": "30s",
                "read-timeout": "30s",
                "write-timeout": "30s"
            }
        }
    },
    "output": {
        "type": "mysql",
        "config": {
            "enable-ddl": true,
            "execution-engine": {
                "use-bidirection": false,
                "use-shading-proxy": false
            },
            "target": {
                "host": "192.168.184.34",
                "port": 38723,
                "username": "root",
                "password": "root",
                "timeout": "30s",
                "read-timeout": "30s",
                "write-timeout": "30s"
            }
        }
    },
    "scheduler": {
        "type": "batch-table-scheduler",
        "config": {
            "batch-size": 1000,
            "nr-worker": 100,
            "queue-size": 4096,
            "sliding-window-size": 10240
        }
    },
    "filters": [{
        "type": "delete-dml-column",
        "config": {
            "match-schema": "ywsdb",
            "match-table": "tab1",
            "columns": ["name"]
        }
    }]
}   

出现的报错信息:

/gravity/pkg/inputs/mysqlbatch/mysql_table_scanner.go:64 ▶ [CRITIC] [TableScanner] initTableDDL for ywsdb.tab1, err: /gravity/pkg/filters/delete_dml_column_filter.go:58: DmlMsg is null /gravity/pkg/emitter/emitter.go:57: /gravity/pkg/inputs/mysqlbatch/mysql_table_scanner.go:613: