search

DataLinkDC / dinky

Dinky is a real-time data development platform based on Apache Flink, enabling agile data development, deployment and operation.
http://www.dinky.org.cn
Apache License 2.0
3.18k stars 1.16k forks source link

[Bug] [CDCSOURCE] The entire mysql database is synchronized to doris, but the sink does not take effect. #2399

Closed yangle123 closed 1 year ago

yangle123 commented 1 year ago

Search before asking

What happened

dinky：0.7.4 flink：1.17.1 mysql: 8.0.33 doris：2.0.0

desc: 整库同步mysql test下的两张表ws和company_info到doris，任务执行成功，flink没有看到错误信息。但并没有同步成功到doris。

flinkSQL：

EXECUTE CDCSOURCE alarm_job WITH (
  'connector' = 'mysql-cdc',
  'hostname' = 'sk-mysql',
  'port' = '3306',
  'username' = 'root',
  'password' = '123456',
  'checkpoint' = '3000',
  'scan.startup.mode' = 'initial',
  'parallelism' = '1',
  'table-name' = 'test\.ws,test\.company_info',
  'source.server-time-zone' = 'Asia/Shanghai',
  'sink.connector' = 'doris',
  'sink.fenodes' = 'sk-doris:8030',
  'sink.username' = 'admin',
  'sink.password' = '123456',
  'sink.sink.batch.size' = '1',
  'sink.sink.max-retries' = '1',
  'sink.sink.batch.interval' = '60000',
  'sink.sink.db' = 'test',
  'sink.table.prefix' = 'ODS_',
  'sink.table.upper' = 'true',
  'sink.table.identifier' = '${schemaName}.${tableName}',
  'sink.sink.enable-delete' = 'true'
);

flink screenshot：

20231018134946

flink taskmanager log:

2023-10-18 05:47:01,544 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Receive slot request 27ebf202b09e9c90894494db96a38de0 for job 67ae02da57ad0648cb0775033a9b9cff from resource manager with leader id 00000000000000000000000000000000.
2023-10-18 05:47:01,545 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Allocated slot for 27ebf202b09e9c90894494db96a38de0.
2023-10-18 05:47:01,545 INFO  org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Add job 67ae02da57ad0648cb0775033a9b9cff for job leader monitoring.
2023-10-18 05:47:01,545 INFO  org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Try to register at job manager akka.tcp://flink@flink-jobmanager:6123/user/rpc/jobmanager_33 with leader id 00000000-0000-0000-0000-000000000000.
2023-10-18 05:47:01,548 INFO  org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Resolved JobManager address, beginning registration
2023-10-18 05:47:01,553 INFO  org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Successful registration at job manager akka.tcp://flink@flink-jobmanager:6123/user/rpc/jobmanager_33 for job 67ae02da57ad0648cb0775033a9b9cff.
2023-10-18 05:47:01,553 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Establish JobManager connection for job 67ae02da57ad0648cb0775033a9b9cff.
2023-10-18 05:47:01,553 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Offer reserved slots to the leader of job 67ae02da57ad0648cb0775033a9b9cff.
2023-10-18 05:47:01,569 INFO  org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot 27ebf202b09e9c90894494db96a38de0.
2023-10-18 05:47:01,571 INFO  org.apache.flink.runtime.state.changelog.StateChangelogStorageLoader [] - Creating a changelog storage with name 'memory'.
2023-10-18 05:47:01,571 INFO  org.apache.flink.runtime.state.TaskExecutorChannelStateExecutorFactoryManager [] - Creating the channel state executor factory for job id 67ae02da57ad0648cb0775033a9b9cff
2023-10-18 05:47:01,571 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Received task Source: MySQL CDC Source -> Map -> Process -> (Flat Map, Flat Map) (1/1)#0 (aa0a9c5ef85dcede5745bf6d4f45826a_cbc357ccb763df2852fee8c4fc7d55f2_0_0), deploy into slot with allocation id 27ebf202b09e9c90894494db96a38de0.
2023-10-18 05:47:01,572 INFO  org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot 27ebf202b09e9c90894494db96a38de0.
2023-10-18 05:47:01,572 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Source: MySQL CDC Source -> Map -> Process -> (Flat Map, Flat Map) (1/1)#0 (aa0a9c5ef85dcede5745bf6d4f45826a_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to DEPLOYING.
2023-10-18 05:47:01,572 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Loading JAR files for task Source: MySQL CDC Source -> Map -> Process -> (Flat Map, Flat Map) (1/1)#0 (aa0a9c5ef85dcede5745bf6d4f45826a_cbc357ccb763df2852fee8c4fc7d55f2_0_0) [DEPLOYING].
2023-10-18 05:47:01,615 INFO  org.apache.flink.streaming.runtime.tasks.StreamTask          [] - Loading state backend via factory org.apache.flink.contrib.streaming.state.EmbeddedRocksDBStateBackendFactory
2023-10-18 05:47:01,615 INFO  org.apache.flink.contrib.streaming.state.EmbeddedRocksDBStateBackend [] - Using predefined options: DEFAULT.
2023-10-18 05:47:01,615 INFO  org.apache.flink.runtime.state.StateBackendLoader            [] - State backend loader loads the state backend as EmbeddedRocksDBStateBackend
2023-10-18 05:47:01,615 INFO  org.apache.flink.streaming.runtime.tasks.StreamTask          [] - Checkpoint storage is set to 'filesystem': (checkpoints "file:/opt/flink/checkpoints")
2023-10-18 05:47:01,616 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Source: MySQL CDC Source -> Map -> Process -> (Flat Map, Flat Map) (1/1)#0 (aa0a9c5ef85dcede5745bf6d4f45826a_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
2023-10-18 05:47:01,675 WARN  org.apache.flink.metrics.MetricGroup                         [] - Name collision: Group already contains a Metric with the name 'currentEmitEventTimeLag'. Metric will not be reported.[10.233.119.149, taskmanager, 10.233.119.149:6122-b66884, 报警数据CDC入数仓, Source: MySQL CDC Source, 0]
2023-10-18 05:47:01,676 WARN  org.apache.flink.metrics.MetricGroup                         [] - Name collision: Group already contains a Metric with the name 'sourceIdleTime'. Metric will not be reported.[10.233.119.149, taskmanager, 10.233.119.149:6122-b66884, 报警数据CDC入数仓, Source: MySQL CDC Source, 0]
2023-10-18 05:47:01,676 INFO  org.apache.flink.runtime.state.StateBackendLoader            [] - Loading state backend via factory org.apache.flink.contrib.streaming.state.EmbeddedRocksDBStateBackendFactory
2023-10-18 05:47:01,676 INFO  org.apache.flink.contrib.streaming.state.EmbeddedRocksDBStateBackend [] - Using predefined options: DEFAULT.
2023-10-18 05:47:01,676 INFO  org.apache.flink.runtime.state.StateBackendLoader            [] - Loading state backend via factory org.apache.flink.contrib.streaming.state.EmbeddedRocksDBStateBackendFactory
2023-10-18 05:47:01,676 INFO  org.apache.flink.contrib.streaming.state.EmbeddedRocksDBStateBackend [] - Using predefined options: DEFAULT.
2023-10-18 05:47:01,676 INFO  org.apache.flink.runtime.state.StateBackendLoader            [] - Loading state backend via factory org.apache.flink.contrib.streaming.state.EmbeddedRocksDBStateBackendFactory
2023-10-18 05:47:01,676 INFO  org.apache.flink.contrib.streaming.state.EmbeddedRocksDBStateBackend [] - Using predefined options: DEFAULT.
2023-10-18 05:47:01,677 INFO  org.apache.flink.runtime.state.StateBackendLoader            [] - Loading state backend via factory org.apache.flink.contrib.streaming.state.EmbeddedRocksDBStateBackendFactory
2023-10-18 05:47:01,677 INFO  org.apache.flink.contrib.streaming.state.EmbeddedRocksDBStateBackend [] - Using predefined options: DEFAULT.
2023-10-18 05:47:01,677 INFO  org.apache.flink.runtime.state.StateBackendLoader            [] - Loading state backend via factory org.apache.flink.contrib.streaming.state.EmbeddedRocksDBStateBackendFactory
2023-10-18 05:47:01,677 INFO  org.apache.flink.contrib.streaming.state.EmbeddedRocksDBStateBackend [] - Using predefined options: DEFAULT.
2023-10-18 05:47:01,678 INFO  org.apache.flink.runtime.taskmanager.Task                    [] - Source: MySQL CDC Source -> Map -> Process -> (Flat Map, Flat Map) (1/1)#0 (aa0a9c5ef85dcede5745bf6d4f45826a_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
2023-10-18 05:47:01,815 INFO  com.ververica.cdc.connectors.mysql.source.reader.MySqlSourceReader [] - Add Split: MySqlSnapshotSplit{tableId=test.company_info, splitId='test.company_info:0', splitKeyType=[`id` INT NOT NULL], splitStart=null, splitEnd=null, highWatermark=null}
2023-10-18 05:47:01,817 INFO  org.apache.flink.connector.base.source.reader.SourceReaderBase [] - Adding split(s) to reader: [MySqlSnapshotSplit{tableId=test.company_info, splitId='test.company_info:0', splitKeyType=[`id` INT NOT NULL], splitStart=null, splitEnd=null, highWatermark=null}]
2023-10-18 05:47:01,817 INFO  org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher [] - Starting split fetcher 0
2023-10-18 05:47:01,817 WARN  io.debezium.connector.mysql.MySqlConnection                  [] - Database configuration option 'serverTimezone' is set but is obsolete, please use 'connectionTimeZone' instead
2023-10-18 05:47:01,837 WARN  io.debezium.relational.history.DatabaseHistoryMetrics        [] - Unable to register the MBean 'debezium.mysql:type=connector-metrics,context=schema-history,server=mysql_binlog_source': debezium.mysql:type=connector-metrics,context=schema-history,server=mysql_binlog_source
2023-10-18 05:47:01,837 INFO  com.ververica.cdc.connectors.mysql.debezium.task.context.StatefulTaskContext [] - Starting offset is initialized to {ts_sec=0, file=, pos=0, kind=EARLIEST, row=0, event=0}
2023-10-18 05:47:01,837 INFO  io.debezium.relational.history.DatabaseHistoryMetrics        [] - Started database history recovery
2023-10-18 05:47:01,837 INFO  io.debezium.relational.history.DatabaseHistoryMetrics        [] - Finished database history recovery of 0 change(s) in 0 ms
2023-10-18 05:47:01,839 INFO  com.ververica.cdc.connectors.mysql.debezium.task.MySqlSnapshotSplitReadTask [] - Snapshot step 1 - Determining low watermark {ts_sec=0, file=binlog.000019, pos=83483582, kind=SPECIFIC, gtids=, row=0, event=0} for split MySqlSnapshotSplit{tableId=test.company_info, splitId='test.company_info:0', splitKeyType=[`id` INT NOT NULL], splitStart=null, splitEnd=null, highWatermark=null}
2023-10-18 05:47:01,839 INFO  com.ververica.cdc.connectors.mysql.debezium.task.MySqlSnapshotSplitReadTask [] - Snapshot step 2 - Snapshotting data
2023-10-18 05:47:01,840 INFO  com.ververica.cdc.connectors.mysql.debezium.task.MySqlSnapshotSplitReadTask [] - Exporting data from split 'test.company_info:0' of table test.company_info
2023-10-18 05:47:01,840 INFO  com.ververica.cdc.connectors.mysql.debezium.task.MySqlSnapshotSplitReadTask [] - For split 'test.company_info:0' of table test.company_info using select statement: 'SELECT * FROM `test`.`company_info`'
2023-10-18 05:47:01,842 INFO  com.ververica.cdc.connectors.mysql.debezium.task.MySqlSnapshotSplitReadTask [] - Finished exporting 1 records for split 'test.company_info:0', total duration '00:00:00.002'
2023-10-18 05:47:01,844 INFO  com.ververica.cdc.connectors.mysql.debezium.task.MySqlSnapshotSplitReadTask [] - Snapshot step 3 - Determining high watermark {ts_sec=0, file=binlog.000019, pos=83483582, kind=SPECIFIC, gtids=, row=0, event=0} for split MySqlSnapshotSplit{tableId=test.company_info, splitId='test.company_info:0', splitKeyType=[`id` INT NOT NULL], splitStart=null, splitEnd=null, highWatermark=null}
2023-10-18 05:47:02,338 INFO  org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher [] - Finished reading from splits [test.company_info:0]
2023-10-18 05:47:02,338 INFO  com.ververica.cdc.connectors.shaded.org.apache.kafka.connect.json.JsonConverterConfig [] - JsonConverterConfig values: 
    converter.type = value
    decimal.format = BASE64
    schemas.cache.size = 1000
    schemas.enable = false

2023-10-18 05:47:02,352 INFO  org.apache.flink.connector.base.source.reader.SourceReaderBase [] - Finished reading split(s) [test.company_info:0]
2023-10-18 05:47:02,353 INFO  org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager [] - Closing splitFetcher 0 because it is idle.
2023-10-18 05:47:02,354 INFO  org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher [] - Shutting down split fetcher 0
2023-10-18 05:47:02,354 INFO  com.ververica.cdc.connectors.mysql.source.reader.MySqlSplitReader [] - Close current debezium reader com.ververica.cdc.connectors.mysql.debezium.reader.SnapshotSplitReader
2023-10-18 05:47:02,359 INFO  io.debezium.jdbc.JdbcConnection                              [] - Connection gracefully closed
2023-10-18 05:47:02,359 WARN  com.ververica.cdc.connectors.mysql.debezium.reader.SnapshotSplitReader [] - Failed to close the snapshot split reader in 30 seconds.
2023-10-18 05:47:02,360 INFO  org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher [] - Split fetcher 0 exited.
2023-10-18 05:47:02,363 INFO  com.ververica.cdc.connectors.mysql.source.reader.MySqlSourceReader [] - Add Split: MySqlSnapshotSplit{tableId=test.ws, splitId='test.ws:0', splitKeyType=[`id` VARCHAR(100) NOT NULL], splitStart=null, splitEnd=null, highWatermark=null}
2023-10-18 05:47:02,363 INFO  org.apache.flink.connector.base.source.reader.SourceReaderBase [] - Adding split(s) to reader: [MySqlSnapshotSplit{tableId=test.ws, splitId='test.ws:0', splitKeyType=[`id` VARCHAR(100) NOT NULL], splitStart=null, splitEnd=null, highWatermark=null}]
2023-10-18 05:47:02,364 INFO  org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher [] - Starting split fetcher 1
2023-10-18 05:47:02,364 WARN  io.debezium.connector.mysql.MySqlConnection                  [] - Database configuration option 'serverTimezone' is set but is obsolete, please use 'connectionTimeZone' instead
2023-10-18 05:47:02,390 WARN  io.debezium.relational.history.DatabaseHistoryMetrics        [] - Unable to register the MBean 'debezium.mysql:type=connector-metrics,context=schema-history,server=mysql_binlog_source': debezium.mysql:type=connector-metrics,context=schema-history,server=mysql_binlog_source
2023-10-18 05:47:02,391 INFO  com.ververica.cdc.connectors.mysql.debezium.task.context.StatefulTaskContext [] - Starting offset is initialized to {ts_sec=0, file=, pos=0, kind=EARLIEST, row=0, event=0}
2023-10-18 05:47:02,391 INFO  io.debezium.relational.history.DatabaseHistoryMetrics        [] - Started database history recovery
2023-10-18 05:47:02,391 INFO  io.debezium.relational.history.DatabaseHistoryMetrics        [] - Finished database history recovery of 0 change(s) in 0 ms
2023-10-18 05:47:02,393 INFO  com.ververica.cdc.connectors.mysql.debezium.task.MySqlSnapshotSplitReadTask [] - Snapshot step 1 - Determining low watermark {ts_sec=0, file=binlog.000019, pos=83511416, kind=SPECIFIC, gtids=, row=0, event=0} for split MySqlSnapshotSplit{tableId=test.ws, splitId='test.ws:0', splitKeyType=[`id` VARCHAR(100) NOT NULL], splitStart=null, splitEnd=null, highWatermark=null}
2023-10-18 05:47:02,393 INFO  com.ververica.cdc.connectors.mysql.debezium.task.MySqlSnapshotSplitReadTask [] - Snapshot step 2 - Snapshotting data
2023-10-18 05:47:02,393 INFO  com.ververica.cdc.connectors.mysql.debezium.task.MySqlSnapshotSplitReadTask [] - Exporting data from split 'test.ws:0' of table test.ws
2023-10-18 05:47:02,393 INFO  com.ververica.cdc.connectors.mysql.debezium.task.MySqlSnapshotSplitReadTask [] - For split 'test.ws:0' of table test.ws using select statement: 'SELECT * FROM `test`.`ws`'
2023-10-18 05:47:02,398 INFO  com.ververica.cdc.connectors.mysql.debezium.task.MySqlSnapshotSplitReadTask [] - Finished exporting 6 records for split 'test.ws:0', total duration '00:00:00.005'
2023-10-18 05:47:02,399 INFO  com.ververica.cdc.connectors.mysql.debezium.task.MySqlSnapshotSplitReadTask [] - Snapshot step 3 - Determining high watermark {ts_sec=0, file=binlog.000019, pos=83511416, kind=SPECIFIC, gtids=, row=0, event=0} for split MySqlSnapshotSplit{tableId=test.ws, splitId='test.ws:0', splitKeyType=[`id` VARCHAR(100) NOT NULL], splitStart=null, splitEnd=null, highWatermark=null}
2023-10-18 05:47:02,892 INFO  org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher [] - Finished reading from splits [test.ws:0]
2023-10-18 05:47:02,895 INFO  org.apache.flink.connector.base.source.reader.SourceReaderBase [] - Finished reading split(s) [test.ws:0]
2023-10-18 05:47:02,895 INFO  org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager [] - Closing splitFetcher 1 because it is idle.
2023-10-18 05:47:02,895 INFO  org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher [] - Shutting down split fetcher 1
2023-10-18 05:47:02,895 INFO  com.ververica.cdc.connectors.mysql.source.reader.MySqlSplitReader [] - Close current debezium reader com.ververica.cdc.connectors.mysql.debezium.reader.SnapshotSplitReader
2023-10-18 05:47:02,897 INFO  io.debezium.jdbc.JdbcConnection                              [] - Connection gracefully closed
2023-10-18 05:47:02,897 WARN  com.ververica.cdc.connectors.mysql.debezium.reader.SnapshotSplitReader [] - Failed to close the snapshot split reader in 30 seconds.
2023-10-18 05:47:02,897 INFO  org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher [] - Split fetcher 1 exited.
2023-10-18 05:47:02,903 INFO  com.ververica.cdc.connectors.mysql.source.reader.MySqlSourceReader [] - Add Split: MySqlBinlogSplit{splitId='binlog-split', offset={ts_sec=0, file=binlog.000019, pos=83483582, kind=SPECIFIC, gtids=, row=0, event=0}, endOffset={ts_sec=0, file=, pos=-9223372036854775808, kind=NON_STOPPING, row=0, event=0}, isSuspended=false}
2023-10-18 05:47:02,903 WARN  io.debezium.connector.mysql.MySqlConnection                  [] - Database configuration option 'serverTimezone' is set but is obsolete, please use 'connectionTimeZone' instead
2023-10-18 05:47:02,903 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] - Read list of available databases
2023-10-18 05:47:02,917 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   list of available databases is: [information_schema, mysql, performance_schema, sys, test]
2023-10-18 05:47:03,051 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.columns_priv' is filtered out of capturing
2023-10-18 05:47:03,051 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.component' is filtered out of capturing
2023-10-18 05:47:03,051 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.db' is filtered out of capturing
2023-10-18 05:47:03,051 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.default_roles' is filtered out of capturing
2023-10-18 05:47:03,051 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.engine_cost' is filtered out of capturing
2023-10-18 05:47:03,051 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.func' is filtered out of capturing
2023-10-18 05:47:03,051 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.general_log' is filtered out of capturing
2023-10-18 05:47:03,051 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.global_grants' is filtered out of capturing
2023-10-18 05:47:03,051 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.gtid_executed' is filtered out of capturing
2023-10-18 05:47:03,051 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.help_category' is filtered out of capturing
2023-10-18 05:47:03,051 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.help_keyword' is filtered out of capturing
2023-10-18 05:47:03,051 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.help_relation' is filtered out of capturing
2023-10-18 05:47:03,051 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.help_topic' is filtered out of capturing
2023-10-18 05:47:03,051 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.innodb_index_stats' is filtered out of capturing
2023-10-18 05:47:03,051 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.innodb_table_stats' is filtered out of capturing
2023-10-18 05:47:03,051 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.ndb_binlog_index' is filtered out of capturing
2023-10-18 05:47:03,051 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.password_history' is filtered out of capturing
2023-10-18 05:47:03,051 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.plugin' is filtered out of capturing
2023-10-18 05:47:03,052 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.procs_priv' is filtered out of capturing
2023-10-18 05:47:03,052 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.proxies_priv' is filtered out of capturing
2023-10-18 05:47:03,052 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.replication_asynchronous_connection_failover' is filtered out of capturing
2023-10-18 05:47:03,052 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.replication_asynchronous_connection_failover_managed' is filtered out of capturing
2023-10-18 05:47:03,052 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.replication_group_configuration_version' is filtered out of capturing
2023-10-18 05:47:03,052 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.replication_group_member_actions' is filtered out of capturing
2023-10-18 05:47:03,052 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.role_edges' is filtered out of capturing
2023-10-18 05:47:03,052 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.server_cost' is filtered out of capturing
2023-10-18 05:47:03,052 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.servers' is filtered out of capturing
2023-10-18 05:47:03,052 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.slave_master_info' is filtered out of capturing
2023-10-18 05:47:03,052 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.slave_relay_log_info' is filtered out of capturing
2023-10-18 05:47:03,052 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.slave_worker_info' is filtered out of capturing
2023-10-18 05:47:03,052 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.slow_log' is filtered out of capturing
2023-10-18 05:47:03,052 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.tables_priv' is filtered out of capturing
2023-10-18 05:47:03,052 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.time_zone' is filtered out of capturing
2023-10-18 05:47:03,052 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.time_zone_leap_second' is filtered out of capturing
2023-10-18 05:47:03,052 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.time_zone_name' is filtered out of capturing
2023-10-18 05:47:03,052 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.time_zone_transition' is filtered out of capturing
2023-10-18 05:47:03,052 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'mysql.time_zone_transition_type' is filtered out of capturing
2023-10-18 05:47:03,072 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.accounts' is filtered out of capturing
2023-10-18 05:47:03,072 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.binary_log_transaction_compression_stats' is filtered out of capturing
2023-10-18 05:47:03,072 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.cond_instances' is filtered out of capturing
2023-10-18 05:47:03,072 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.data_lock_waits' is filtered out of capturing
2023-10-18 05:47:03,072 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.data_locks' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.error_log' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_errors_summary_by_account_by_error' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_errors_summary_by_host_by_error' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_errors_summary_by_thread_by_error' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_errors_summary_by_user_by_error' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_errors_summary_global_by_error' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_stages_current' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_stages_history' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_stages_history_long' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_stages_summary_by_account_by_event_name' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_stages_summary_by_host_by_event_name' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_stages_summary_by_thread_by_event_name' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_stages_summary_by_user_by_event_name' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_stages_summary_global_by_event_name' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_statements_current' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_statements_histogram_by_digest' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_statements_histogram_global' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_statements_history' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_statements_history_long' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_statements_summary_by_account_by_event_name' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_statements_summary_by_digest' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_statements_summary_by_host_by_event_name' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_statements_summary_by_program' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_statements_summary_by_thread_by_event_name' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_statements_summary_by_user_by_event_name' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_statements_summary_global_by_event_name' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_transactions_current' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_transactions_history' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_transactions_history_long' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_transactions_summary_by_account_by_event_name' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_transactions_summary_by_host_by_event_name' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_transactions_summary_by_thread_by_event_name' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_transactions_summary_by_user_by_event_name' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_transactions_summary_global_by_event_name' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_waits_current' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_waits_history' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_waits_history_long' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_waits_summary_by_account_by_event_name' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_waits_summary_by_host_by_event_name' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_waits_summary_by_instance' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_waits_summary_by_thread_by_event_name' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_waits_summary_by_user_by_event_name' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.events_waits_summary_global_by_event_name' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.file_instances' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.file_summary_by_event_name' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.file_summary_by_instance' is filtered out of capturing
2023-10-18 05:47:03,073 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.global_status' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.global_variables' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.host_cache' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.hosts' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.innodb_redo_log_files' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.keyring_component_status' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.keyring_keys' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.log_status' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.memory_summary_by_account_by_event_name' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.memory_summary_by_host_by_event_name' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.memory_summary_by_thread_by_event_name' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.memory_summary_by_user_by_event_name' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.memory_summary_global_by_event_name' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.metadata_locks' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.mutex_instances' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.objects_summary_global_by_type' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.performance_timers' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.persisted_variables' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.prepared_statements_instances' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.processlist' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.replication_applier_configuration' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.replication_applier_filters' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.replication_applier_global_filters' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.replication_applier_status' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.replication_applier_status_by_coordinator' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.replication_applier_status_by_worker' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.replication_asynchronous_connection_failover' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.replication_asynchronous_connection_failover_managed' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.replication_connection_configuration' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.replication_connection_status' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.replication_group_member_stats' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.replication_group_members' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.rwlock_instances' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.session_account_connect_attrs' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.session_connect_attrs' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.session_status' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.session_variables' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.setup_actors' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.setup_consumers' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.setup_instruments' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.setup_objects' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.setup_threads' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.socket_instances' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.socket_summary_by_event_name' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.socket_summary_by_instance' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.status_by_account' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.status_by_host' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.status_by_thread' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.status_by_user' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.table_handles' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.table_io_waits_summary_by_index_usage' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.table_io_waits_summary_by_table' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.table_lock_waits_summary_by_table' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.threads' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.tls_channel_status' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.user_defined_functions' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.user_variables_by_thread' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.users' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.variables_by_thread' is filtered out of capturing
2023-10-18 05:47:03,074 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'performance_schema.variables_info' is filtered out of capturing
2023-10-18 05:47:03,107 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'sys.sys_config' is filtered out of capturing
2023-10-18 05:47:03,110 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'test.cdc' is filtered out of capturing
2023-10-18 05:47:03,110 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   including 'test.company_info' for further processing
2023-10-18 05:47:03,110 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   'test.kafka_data' is filtered out of capturing
2023-10-18 05:47:03,110 INFO  com.ververica.cdc.connectors.mysql.source.utils.TableDiscoveryUtils [] -   including 'test.ws' for further processing

2023-10-18 05:47:03,130 WARN  io.debezium.relational.history.DatabaseHistoryMetrics        [] - Unable to register the MBean 'debezium.mysql:type=connector-metrics,context=schema-history,server=mysql_binlog_source': debezium.mysql:type=connector-metrics,context=schema-history,server=mysql_binlog_source
2023-10-18 05:47:03,137 INFO  com.ververica.cdc.connectors.mysql.source.reader.MySqlSourceReader [] - The table schema discovery for binlog split binlog-split success
2023-10-18 05:47:03,138 INFO  io.debezium.jdbc.JdbcConnection                              [] - Connection gracefully closed
2023-10-18 05:47:03,138 INFO  org.apache.flink.connector.base.source.reader.SourceReaderBase [] - Adding split(s) to reader: [MySqlBinlogSplit{splitId='binlog-split', offset={ts_sec=0, file=binlog.000019, pos=83483582, kind=SPECIFIC, gtids=, row=0, event=0}, endOffset={ts_sec=0, file=, pos=-9223372036854775808, kind=NON_STOPPING, row=0, event=0}, isSuspended=false}]
2023-10-18 05:47:03,138 INFO  org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher [] - Starting split fetcher 2
2023-10-18 05:47:03,138 WARN  io.debezium.connector.mysql.MySqlConnection                  [] - Database configuration option 'serverTimezone' is set but is obsolete, please use 'connectionTimeZone' instead
2023-10-18 05:47:03,139 INFO  com.ververica.cdc.connectors.mysql.source.reader.MySqlSplitReader [] - BinlogSplitReader is created.
2023-10-18 05:47:03,156 WARN  io.debezium.relational.history.DatabaseHistoryMetrics        [] - Unable to register the MBean 'debezium.mysql:type=connector-metrics,context=schema-history,server=mysql_binlog_source': debezium.mysql:type=connector-metrics,context=schema-history,server=mysql_binlog_source
2023-10-18 05:47:03,156 INFO  com.ververica.cdc.connectors.mysql.debezium.task.context.StatefulTaskContext [] - Starting offset is initialized to {ts_sec=0, file=binlog.000019, pos=83483582, kind=SPECIFIC, gtids=, row=0, event=0}
2023-10-18 05:47:03,157 INFO  io.debezium.connector.mysql.MySqlConnection                  [] - Get all known binlogs from MySQL
2023-10-18 05:47:03,164 INFO  com.ververica.cdc.connectors.mysql.debezium.task.context.StatefulTaskContext [] - MySQL has the binlog file 'binlog.000019' required by the connector
2023-10-18 05:47:03,164 INFO  io.debezium.relational.history.DatabaseHistoryMetrics        [] - Started database history recovery
2023-10-18 05:47:03,164 INFO  io.debezium.relational.history.DatabaseHistoryMetrics        [] - Finished database history recovery of 0 change(s) in 0 ms
2023-10-18 05:47:03,165 INFO  io.debezium.util.Threads                                     [] - Requested thread factory for connector MySqlConnector, id = mysql_binlog_source named = binlog-client
2023-10-18 05:47:03,172 INFO  io.debezium.connector.mysql.MySqlStreamingChangeEventSource  [] - Skip 0 events on streaming start
2023-10-18 05:47:03,173 INFO  io.debezium.connector.mysql.MySqlStreamingChangeEventSource  [] - Skip 0 rows on streaming start
2023-10-18 05:47:03,173 INFO  io.debezium.util.Threads                                     [] - Creating thread debezium-mysqlconnector-mysql_binlog_source-binlog-client
2023-10-18 05:47:03,174 INFO  io.debezium.util.Threads                                     [] - Creating thread debezium-mysqlconnector-mysql_binlog_source-binlog-client
2023-10-18 05:47:03,190 INFO  io.debezium.connector.mysql.MySqlStreamingChangeEventSource  [] - Connected to MySQL binlog at sk-mysql:3306, starting at MySqlOffsetContext [sourceInfoSchema=Schema{io.debezium.connector.mysql.Source:STRUCT}, sourceInfo=SourceInfo [currentGtid=null, currentBinlogFilename=binlog.000019, currentBinlogPosition=83483582, currentRowNumber=0, serverId=0, sourceTime=null, threadId=-1, currentQuery=null, tableIds=[], databaseName=null], partition={server=mysql_binlog_source}, snapshotCompleted=false, transactionContext=TransactionContext [currentTransactionId=null, perTableEventCount={}, totalEventCount=0], restartGtidSet=null, currentGtidSet=null, restartBinlogFilename=binlog.000019, restartBinlogPosition=83483582, restartRowsToSkip=0, restartEventsToSkip=0, currentEventLengthInBytes=0, inTransaction=false, transactionId=null, incrementalSnapshotContext =IncrementalSnapshotContext [windowOpened=false, chunkEndPosition=null, dataCollectionsToSnapshot=[], lastEventKeySent=null, maximumKey=null]]
2023-10-18 05:47:03,190 INFO  io.debezium.util.Threads                                     [] - Creating thread debezium-mysqlconnector-mysql_binlog_source-binlog-client
2023-10-18 05:47:03,190 INFO  io.debezium.connector.mysql.MySqlStreamingChangeEventSource  [] - Waiting for keepalive thread to start
2023-10-18 05:47:03,290 INFO  io.debezium.connector.mysql.MySqlStreamingChangeEventSource  [] - Keepalive thread is running
2023-10-18 05:47:05,732 INFO  com.ververica.cdc.connectors.mysql.source.reader.MySqlSourceReader [] - Binlog offset on checkpoint 2: {ts_sec=0, file=binlog.000019, pos=83483582, kind=SPECIFIC, gtids=, row=0, event=0}
2023-10-18 05:47:08,732 INFO  com.ververica.cdc.connectors.mysql.source.reader.MySqlSourceReader [] - Binlog offset on checkpoint 3: {ts_sec=0, file=binlog.000019, pos=83483582, kind=SPECIFIC, gtids=, row=0, event=0}
2023-10-18 05:47:11,732 INFO  com.ververica.cdc.connectors.mysql.source.reader.MySqlSourceReader [] - Binlog offset on checkpoint 4: {ts_sec=0, file=binlog.000019, pos=83483582, kind=SPECIFIC, gtids=, row=0, event=0}
2023-10-18 05:47:14,732 INFO  com.ververica.cdc.connectors.mysql.source.reader.MySqlSourceReader [] - Binlog offset on checkpoint 5: {ts_sec=0, file=binlog.000019, pos=83483582, kind=SPECIFIC, gtids=, row=0, event=0}

What you expected to happen

也使用datastream-doris代替doris，是一样的问题。

How to reproduce

用上述环境重现

Anything else

No response

Version

dev

Are you willing to submit PR?

Code of Conduct

aiwenmo commented 1 year ago

The sink operator was not successfully constructed. Please check the error message in the log.

baron-fly commented 6 months ago

我和你遇到的问题一样，请问您解决这个问题了吗？