search

dyrnq / Stream-Data

This is a project for some basic big data exercise.
0 stars 0 forks source link

io.debezium.embedded.EmbeddedEngine:618 - Error while trying to run connector class 'io.debezium.connector.mysql.MySqlConnector' #33

Open dyrnq opened 11 months ago

dyrnq commented 11 months ago

when 

.with(MySqlConnectorConfig.SNAPSHOT_MODE,"never")

get errors

2023-10-31 09:39:54 INFO  [blc-192.168.6.215:23306] io.debezium.connector.mysql.MySqlStreamingChangeEventSource:1270 - Stopped reading binlog after 0 events, last recorded offset: {transaction_id=null, file=mysql-bin.000005, pos=4, server_id=223344, event=18}
2023-10-31 09:39:54 INFO  [debezium-mysqlconnector-my-app-connector-change-event-source-coordinator] io.debezium.pipeline.ChangeEventSourceCoordinator:273 - Finished streaming
2023-10-31 09:39:54 INFO  [pool-1-thread-1] io.debezium.pipeline.signal.SignalProcessor:127 - SignalProcessor stopped
2023-10-31 09:39:54 INFO  [pool-4-thread-1] io.debezium.jdbc.JdbcConnection:947 - Connection gracefully closed
2023-10-31 09:39:54 INFO  [pool-1-thread-1] org.apache.kafka.connect.storage.FileOffsetBackingStore:71 - Stopped FileOffsetBackingStore
2023-10-31 09:39:54 ERROR [pool-1-thread-1] io.debezium.embedded.EmbeddedEngine:618 - Error while trying to run connector class 'io.debezium.connector.mysql.MySqlConnector'
org.apache.kafka.connect.errors.ConnectException: An exception occurred in the change event producer. This connector will be stopped.
    at io.debezium.pipeline.ErrorHandler.setProducerThrowable(ErrorHandler.java:67)
    at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.handleEvent(MySqlStreamingChangeEventSource.java:395)
    at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.lambda$execute$27(MySqlStreamingChangeEventSource.java:930)
    at com.github.shyiko.mysql.binlog.BinaryLogClient.notifyEventListeners(BinaryLogClient.java:1246)
    at com.github.shyiko.mysql.binlog.BinaryLogClient.listenForEventPackets(BinaryLogClient.java:1072)
    at com.github.shyiko.mysql.binlog.BinaryLogClient.connect(BinaryLogClient.java:631)
    at com.github.shyiko.mysql.binlog.BinaryLogClient$7.run(BinaryLogClient.java:932)
    at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: io.debezium.DebeziumException: Error processing binlog event
    ... 7 more
Caused by: io.debezium.DebeziumException: Encountered change event for table inventory.addresses whose schema isn't known to this connector
    at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.informAboutUnknownTableIfRequired(MySqlStreamingChangeEventSource.java:700)
    at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.informAboutUnknownTableIfRequired(MySqlStreamingChangeEventSource.java:741)
    at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.handleUpdateTableMetadata(MySqlStreamingChangeEventSource.java:656)
    at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.lambda$execute$14(MySqlStreamingChangeEventSource.java:900)
    at io.debezium.connector.mysql.MySqlStreamingChangeEventSource.handleEvent(MySqlStreamingChangeEventSource.java:375)
    ... 6 more