Error reported when using FlinkCDC full library synchronization function

zhaobbc123 commented 10 months ago

Search before asking

[X] I had searched in the issues and found no similar issues.

What happened

版本 dinky1.0.0 flink1.17.2 使用整库同步功能代码 EXECUTE CDCSOURCE demo_print WITH ( 'connector' = 'mysql-cdc', 'hostname' = 'bd1', 'port' = '3306', 'username' = 'root', 'password' = 'xxxxx', 'checkpoint' = '10000', 'scan.startup.mode' = 'initial', 'parallelism' = '1', 'table-name' = 'test1.student', 'sink.connector' = 'print' );

What you expected to happen

2024-01-09 09:42:39,124 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - anonymous_datastream_source$2[3] -> ConstraintEnforcer[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_f6dc7f4d2283f4605b127b9364e21148_0_1) switched from CREATED to SCHEDULED. 2024-01-09 09:42:39,124 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - SinkMaterializer[4] -> Sink: student[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_ac517e93166644a0922111980a6172f5_0_1) switched from CREATED to SCHEDULED. 2024-01-09 09:42:39,126 INFO org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager [] - Received resource requirements from job a5ab5a452ec08cd4ac3354897f00182e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}] 2024-01-09 09:42:39,127 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: MySQL CDC Source -> Map -> Process -> Flat Map (1/1) (81f0b2217f899cd60a2953578f5e782a_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from SCHEDULED to DEPLOYING. 2024-01-09 09:42:39,127 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying Source: MySQL CDC Source -> Map -> Process -> Flat Map (1/1) (attempt #1) with attempt id 81f0b2217f899cd60a2953578f5e782a_cbc357ccb763df2852fee8c4fc7d55f2_0_1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to container_e02_1702977012832_0303_01_000002 @ bd5 (dataPort=42286) with allocation id 706e696f295daa876866ebce50576691 2024-01-09 09:42:39,127 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - anonymous_datastream_source$2[3] -> ConstraintEnforcer[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_f6dc7f4d2283f4605b127b9364e21148_0_1) switched from SCHEDULED to DEPLOYING. 2024-01-09 09:42:39,128 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying anonymous_datastream_source$2[3] -> ConstraintEnforcer[4] (1/1) (attempt #1) with attempt id 81f0b2217f899cd60a2953578f5e782a_f6dc7f4d2283f4605b127b9364e21148_0_1 and vertex id f6dc7f4d2283f4605b127b9364e21148_0 to container_e02_1702977012832_0303_01_000002 @ bd5 (dataPort=42286) with allocation id 706e696f295daa876866ebce50576691 2024-01-09 09:42:39,128 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - SinkMaterializer[4] -> Sink: student[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_ac517e93166644a0922111980a6172f5_0_1) switched from SCHEDULED to DEPLOYING. 2024-01-09 09:42:39,129 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying SinkMaterializer[4] -> Sink: student[4] (1/1) (attempt #1) with attempt id 81f0b2217f899cd60a2953578f5e782a_ac517e93166644a0922111980a6172f5_0_1 and vertex id ac517e93166644a0922111980a6172f5_0 to container_e02_1702977012832_0303_01_000002 @ bd5 (dataPort=42286) with allocation id 706e696f295daa876866ebce50576691 2024-01-09 09:42:39,142 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: MySQL CDC Source -> Map -> Process -> Flat Map (1/1) (81f0b2217f899cd60a2953578f5e782a_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from DEPLOYING to INITIALIZING. 2024-01-09 09:42:39,150 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - SinkMaterializer[4] -> Sink: student[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_ac517e93166644a0922111980a6172f5_0_1) switched from DEPLOYING to INITIALIZING. 2024-01-09 09:42:39,162 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: MySQL CDC Source -> Map -> Process -> Flat Map (1/1) (81f0b2217f899cd60a2953578f5e782a_cbc357ccb763df2852fee8c4fc7d55f2_0_1) switched from INITIALIZING to FAILED on container_e02_1702977012832_0303_01_000002 @ bd5 (dataPort=42286). org.apache.flink.streaming.runtime.tasks.StreamTaskException: Cannot instantiate user function. at org.apache.flink.streaming.api.graph.StreamConfig.getStreamOperatorFactory(StreamConfig.java:405) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperator(OperatorChain.java:837) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperatorChain(OperatorChain.java:804) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:722) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperatorChain(OperatorChain.java:793) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:722) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperatorChain(OperatorChain.java:793) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:722) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.(OperatorChain.java:199) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.(RegularOperatorChain.java:60) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:688) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:675) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:952) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:921) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:745) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.runtime.taskmanager.Task.run(Task.java:562) ~[flink-dist-1.17.2.jar:1.17.2] at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_181] Caused by: java.lang.ClassCastException: cannot assign instance of java.lang.invoke.SerializedLambda to field org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.userFunction of type org.apache.flink.api.common.functions.Function in instance of org.apache.flink.streaming.api.operators.StreamFlatMap at java.io.ObjectStreamClass$FieldReflector.setObjFieldValues(ObjectStreamClass.java:2287) ~[?:1.8.0_181] at java.io.ObjectStreamClass.setObjFieldValues(ObjectStreamClass.java:1417) ~[?:1.8.0_181] at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2293) ~[?:1.8.0_181] at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2211) ~[?:1.8.0_181] at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2069) ~[?:1.8.0_181] at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573) ~[?:1.8.0_181] at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2287) ~[?:1.8.0_181] at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2211) ~[?:1.8.0_181] at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2069) ~[?:1.8.0_181] at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573) ~[?:1.8.0_181] at java.io.ObjectInputStream.readObject(ObjectInputStream.java:431) ~[?:1.8.0_181] at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:534) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:522) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.util.InstantiationUtil.readObjectFromConfig(InstantiationUtil.java:476) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.api.graph.StreamConfig.getStreamOperatorFactory(StreamConfig.java:389) ~[flink-dist-1.17.2.jar:1.17.2] ... 16 more 2024-01-09 09:42:39,165 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - 3 tasks will be restarted to recover the failed task 81f0b2217f899cd60a2953578f5e782a_cbc357ccb763df2852fee8c4fc7d55f2_0_1. 2024-01-09 09:42:39,165 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job demo1 (a5ab5a452ec08cd4ac3354897f00182e) switched from state RUNNING to RESTARTING. 2024-01-09 09:42:39,165 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - SinkMaterializer[4] -> Sink: student[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_ac517e93166644a0922111980a6172f5_0_1) switched from INITIALIZING to CANCELING. 2024-01-09 09:42:39,166 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - anonymous_datastream_source$2[3] -> ConstraintEnforcer[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_f6dc7f4d2283f4605b127b9364e21148_0_1) switched from DEPLOYING to CANCELING. 2024-01-09 09:42:39,166 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Removing registered reader after failure for subtask 0 (#1) of source Source: MySQL CDC Source. 2024-01-09 09:42:39,200 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - anonymous_datastream_source$2[3] -> ConstraintEnforcer[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_f6dc7f4d2283f4605b127b9364e21148_0_1) switched from CANCELING to CANCELED. 2024-01-09 09:42:39,364 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - SinkMaterializer[4] -> Sink: student[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_ac517e93166644a0922111980a6172f5_0_1) switched from CANCELING to CANCELED. 2024-01-09 09:42:39,365 INFO org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager [] - Clearing resource requirements of job a5ab5a452ec08cd4ac3354897f00182e 2024-01-09 09:42:40,167 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job demo1 (a5ab5a452ec08cd4ac3354897f00182e) switched from state RESTARTING to RUNNING. 2024-01-09 09:42:40,168 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - No checkpoint found during restore. 2024-01-09 09:42:40,168 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Recovering subtask 0 to checkpoint -1 for source Source: MySQL CDC Source to checkpoint. 2024-01-09 09:42:40,168 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: MySQL CDC Source -> Map -> Process -> Flat Map (1/1) (81f0b2217f899cd60a2953578f5e782a_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from CREATED to SCHEDULED. 2024-01-09 09:42:40,168 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - anonymous_datastream_source$2[3] -> ConstraintEnforcer[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_f6dc7f4d2283f4605b127b9364e21148_0_2) switched from CREATED to SCHEDULED. 2024-01-09 09:42:40,168 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - SinkMaterializer[4] -> Sink: student[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_ac517e93166644a0922111980a6172f5_0_2) switched from CREATED to SCHEDULED. 2024-01-09 09:42:40,169 INFO org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager [] - Received resource requirements from job a5ab5a452ec08cd4ac3354897f00182e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}] 2024-01-09 09:42:40,169 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: MySQL CDC Source -> Map -> Process -> Flat Map (1/1) (81f0b2217f899cd60a2953578f5e782a_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from SCHEDULED to DEPLOYING. 2024-01-09 09:42:40,170 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying Source: MySQL CDC Source -> Map -> Process -> Flat Map (1/1) (attempt #2) with attempt id 81f0b2217f899cd60a2953578f5e782a_cbc357ccb763df2852fee8c4fc7d55f2_0_2 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to container_e02_1702977012832_0303_01_000002 @ bd5 (dataPort=42286) with allocation id 706e696f295daa876866ebce50576691 2024-01-09 09:42:40,170 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - anonymous_datastream_source$2[3] -> ConstraintEnforcer[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_f6dc7f4d2283f4605b127b9364e21148_0_2) switched from SCHEDULED to DEPLOYING. 2024-01-09 09:42:40,170 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying anonymous_datastream_source$2[3] -> ConstraintEnforcer[4] (1/1) (attempt #2) with attempt id 81f0b2217f899cd60a2953578f5e782a_f6dc7f4d2283f4605b127b9364e21148_0_2 and vertex id f6dc7f4d2283f4605b127b9364e21148_0 to container_e02_1702977012832_0303_01_000002 @ bd5 (dataPort=42286) with allocation id 706e696f295daa876866ebce50576691 2024-01-09 09:42:40,172 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - SinkMaterializer[4] -> Sink: student[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_ac517e93166644a0922111980a6172f5_0_2) switched from SCHEDULED to DEPLOYING. 2024-01-09 09:42:40,173 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying SinkMaterializer[4] -> Sink: student[4] (1/1) (attempt #2) with attempt id 81f0b2217f899cd60a2953578f5e782a_ac517e93166644a0922111980a6172f5_0_2 and vertex id ac517e93166644a0922111980a6172f5_0 to container_e02_1702977012832_0303_01_000002 @ bd5 (dataPort=42286) with allocation id 706e696f295daa876866ebce50576691 2024-01-09 09:42:40,194 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: MySQL CDC Source -> Map -> Process -> Flat Map (1/1) (81f0b2217f899cd60a2953578f5e782a_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from DEPLOYING to INITIALIZING. 2024-01-09 09:42:40,195 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - anonymous_datastream_source$2[3] -> ConstraintEnforcer[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_f6dc7f4d2283f4605b127b9364e21148_0_2) switched from DEPLOYING to INITIALIZING. 2024-01-09 09:42:40,197 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - SinkMaterializer[4] -> Sink: student[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_ac517e93166644a0922111980a6172f5_0_2) switched from DEPLOYING to INITIALIZING. 2024-01-09 09:42:40,217 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - anonymous_datastream_source$2[3] -> ConstraintEnforcer[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_f6dc7f4d2283f4605b127b9364e21148_0_2) switched from INITIALIZING to RUNNING. 2024-01-09 09:42:40,225 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: MySQL CDC Source -> Map -> Process -> Flat Map (1/1) (81f0b2217f899cd60a2953578f5e782a_cbc357ccb763df2852fee8c4fc7d55f2_0_2) switched from INITIALIZING to FAILED on container_e02_1702977012832_0303_01_000002 @ bd5 (dataPort=42286). org.apache.flink.streaming.runtime.tasks.StreamTaskException: Cannot instantiate user function. at org.apache.flink.streaming.api.graph.StreamConfig.getStreamOperatorFactory(StreamConfig.java:405) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperator(OperatorChain.java:837) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperatorChain(OperatorChain.java:804) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:722) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperatorChain(OperatorChain.java:793) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:722) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperatorChain(OperatorChain.java:793) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:722) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.(OperatorChain.java:199) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.(RegularOperatorChain.java:60) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:688) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:675) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:952) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:921) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:745) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.runtime.taskmanager.Task.run(Task.java:562) ~[flink-dist-1.17.2.jar:1.17.2] at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_181] Caused by: java.lang.ClassCastException: cannot assign instance of java.lang.invoke.SerializedLambda to field org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.userFunction of type org.apache.flink.api.common.functions.Function in instance of org.apache.flink.streaming.api.operators.StreamFlatMap at java.io.ObjectStreamClass$FieldReflector.setObjFieldValues(ObjectStreamClass.java:2287) ~[?:1.8.0_181] at java.io.ObjectStreamClass.setObjFieldValues(ObjectStreamClass.java:1417) ~[?:1.8.0_181] at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2293) ~[?:1.8.0_181] at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2211) ~[?:1.8.0_181] at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2069) ~[?:1.8.0_181] at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573) ~[?:1.8.0_181] at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2287) ~[?:1.8.0_181] at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2211) ~[?:1.8.0_181] at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2069) ~[?:1.8.0_181] at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573) ~[?:1.8.0_181] at java.io.ObjectInputStream.readObject(ObjectInputStream.java:431) ~[?:1.8.0_181] at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:534) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:522) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.util.InstantiationUtil.readObjectFromConfig(InstantiationUtil.java:476) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.api.graph.StreamConfig.getStreamOperatorFactory(StreamConfig.java:389) ~[flink-dist-1.17.2.jar:1.17.2] ... 16 more 2024-01-09 09:42:40,229 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - 3 tasks will be restarted to recover the failed task 81f0b2217f899cd60a2953578f5e782a_cbc357ccb763df2852fee8c4fc7d55f2_0_2. 2024-01-09 09:42:40,230 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job demo1 (a5ab5a452ec08cd4ac3354897f00182e) switched from state RUNNING to RESTARTING. 2024-01-09 09:42:40,230 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - SinkMaterializer[4] -> Sink: student[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_ac517e93166644a0922111980a6172f5_0_2) switched from INITIALIZING to CANCELING. 2024-01-09 09:42:40,230 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - anonymous_datastream_source$2[3] -> ConstraintEnforcer[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_f6dc7f4d2283f4605b127b9364e21148_0_2) switched from RUNNING to CANCELING. 2024-01-09 09:42:40,231 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Removing registered reader after failure for subtask 0 (#2) of source Source: MySQL CDC Source. 2024-01-09 09:42:40,247 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - SinkMaterializer[4] -> Sink: student[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_ac517e93166644a0922111980a6172f5_0_2) switched from CANCELING to CANCELED. 2024-01-09 09:42:40,258 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - anonymous_datastream_source$2[3] -> ConstraintEnforcer[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_f6dc7f4d2283f4605b127b9364e21148_0_2) switched from CANCELING to CANCELED. 2024-01-09 09:42:40,258 INFO org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager [] - Clearing resource requirements of job a5ab5a452ec08cd4ac3354897f00182e 2024-01-09 09:42:41,232 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job demo1 (a5ab5a452ec08cd4ac3354897f00182e) switched from state RESTARTING to RUNNING. 2024-01-09 09:42:41,232 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - No checkpoint found during restore. 2024-01-09 09:42:41,232 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Recovering subtask 0 to checkpoint -1 for source Source: MySQL CDC Source to checkpoint. 2024-01-09 09:42:41,233 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: MySQL CDC Source -> Map -> Process -> Flat Map (1/1) (81f0b2217f899cd60a2953578f5e782a_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from CREATED to SCHEDULED. 2024-01-09 09:42:41,233 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - anonymous_datastream_source$2[3] -> ConstraintEnforcer[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_f6dc7f4d2283f4605b127b9364e21148_0_3) switched from CREATED to SCHEDULED. 2024-01-09 09:42:41,233 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - SinkMaterializer[4] -> Sink: student[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_ac517e93166644a0922111980a6172f5_0_3) switched from CREATED to SCHEDULED. 2024-01-09 09:42:41,234 INFO org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager [] - Received resource requirements from job a5ab5a452ec08cd4ac3354897f00182e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}] 2024-01-09 09:42:41,234 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: MySQL CDC Source -> Map -> Process -> Flat Map (1/1) (81f0b2217f899cd60a2953578f5e782a_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from SCHEDULED to DEPLOYING. 2024-01-09 09:42:41,234 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying Source: MySQL CDC Source -> Map -> Process -> Flat Map (1/1) (attempt #3) with attempt id 81f0b2217f899cd60a2953578f5e782a_cbc357ccb763df2852fee8c4fc7d55f2_0_3 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to container_e02_1702977012832_0303_01_000002 @ bd5 (dataPort=42286) with allocation id 706e696f295daa876866ebce50576691 2024-01-09 09:42:41,234 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - anonymous_datastream_source$2[3] -> ConstraintEnforcer[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_f6dc7f4d2283f4605b127b9364e21148_0_3) switched from SCHEDULED to DEPLOYING. 2024-01-09 09:42:41,234 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying anonymous_datastream_source$2[3] -> ConstraintEnforcer[4] (1/1) (attempt #3) with attempt id 81f0b2217f899cd60a2953578f5e782a_f6dc7f4d2283f4605b127b9364e21148_0_3 and vertex id f6dc7f4d2283f4605b127b9364e21148_0 to container_e02_1702977012832_0303_01_000002 @ bd5 (dataPort=42286) with allocation id 706e696f295daa876866ebce50576691 2024-01-09 09:42:41,235 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - SinkMaterializer[4] -> Sink: student[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_ac517e93166644a0922111980a6172f5_0_3) switched from SCHEDULED to DEPLOYING. 2024-01-09 09:42:41,235 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying SinkMaterializer[4] -> Sink: student[4] (1/1) (attempt #3) with attempt id 81f0b2217f899cd60a2953578f5e782a_ac517e93166644a0922111980a6172f5_0_3 and vertex id ac517e93166644a0922111980a6172f5_0 to container_e02_1702977012832_0303_01_000002 @ bd5 (dataPort=42286) with allocation id 706e696f295daa876866ebce50576691 2024-01-09 09:42:41,246 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: MySQL CDC Source -> Map -> Process -> Flat Map (1/1) (81f0b2217f899cd60a2953578f5e782a_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from DEPLOYING to INITIALIZING. 2024-01-09 09:42:41,260 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - SinkMaterializer[4] -> Sink: student[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_ac517e93166644a0922111980a6172f5_0_3) switched from DEPLOYING to INITIALIZING. 2024-01-09 09:42:41,271 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: MySQL CDC Source -> Map -> Process -> Flat Map (1/1) (81f0b2217f899cd60a2953578f5e782a_cbc357ccb763df2852fee8c4fc7d55f2_0_3) switched from INITIALIZING to FAILED on container_e02_1702977012832_0303_01_000002 @ bd5 (dataPort=42286). org.apache.flink.streaming.runtime.tasks.StreamTaskException: Cannot instantiate user function. at org.apache.flink.streaming.api.graph.StreamConfig.getStreamOperatorFactory(StreamConfig.java:405) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperator(OperatorChain.java:837) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperatorChain(OperatorChain.java:804) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:722) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperatorChain(OperatorChain.java:793) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:722) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperatorChain(OperatorChain.java:793) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:722) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.(OperatorChain.java:199) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.(RegularOperatorChain.java:60) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:688) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:675) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:952) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:921) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:745) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.runtime.taskmanager.Task.run(Task.java:562) ~[flink-dist-1.17.2.jar:1.17.2] at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_181] Caused by: java.lang.ClassCastException: cannot assign instance of java.lang.invoke.SerializedLambda to field org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.userFunction of type org.apache.flink.api.common.functions.Function in instance of org.apache.flink.streaming.api.operators.StreamFlatMap at java.io.ObjectStreamClass$FieldReflector.setObjFieldValues(ObjectStreamClass.java:2287) ~[?:1.8.0_181] at java.io.ObjectStreamClass.setObjFieldValues(ObjectStreamClass.java:1417) ~[?:1.8.0_181] at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2293) ~[?:1.8.0_181] at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2211) ~[?:1.8.0_181] at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2069) ~[?:1.8.0_181] at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573) ~[?:1.8.0_181] at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2287) ~[?:1.8.0_181] at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2211) ~[?:1.8.0_181] at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2069) ~[?:1.8.0_181] at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573) ~[?:1.8.0_181] at java.io.ObjectInputStream.readObject(ObjectInputStream.java:431) ~[?:1.8.0_181] at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:534) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:522) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.util.InstantiationUtil.readObjectFromConfig(InstantiationUtil.java:476) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.api.graph.StreamConfig.getStreamOperatorFactory(StreamConfig.java:389) ~[flink-dist-1.17.2.jar:1.17.2] ... 16 more 2024-01-09 09:42:41,275 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Removing registered reader after failure for subtask 0 (#3) of source Source: MySQL CDC Source. 2024-01-09 09:42:41,275 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - 3 tasks will be restarted to recover the failed task 81f0b2217f899cd60a2953578f5e782a_cbc357ccb763df2852fee8c4fc7d55f2_0_3. 2024-01-09 09:42:41,275 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job demo1 (a5ab5a452ec08cd4ac3354897f00182e) switched from state RUNNING to RESTARTING. 2024-01-09 09:42:41,275 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - SinkMaterializer[4] -> Sink: student[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_ac517e93166644a0922111980a6172f5_0_3) switched from INITIALIZING to CANCELING. 2024-01-09 09:42:41,276 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - anonymous_datastream_source$2[3] -> ConstraintEnforcer[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_f6dc7f4d2283f4605b127b9364e21148_0_3) switched from DEPLOYING to CANCELING. 2024-01-09 09:42:41,332 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - SinkMaterializer[4] -> Sink: student[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_ac517e93166644a0922111980a6172f5_0_3) switched from CANCELING to CANCELED. 2024-01-09 09:42:41,339 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - anonymous_datastream_source$2[3] -> ConstraintEnforcer[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_f6dc7f4d2283f4605b127b9364e21148_0_3) switched from CANCELING to CANCELED. 2024-01-09 09:42:41,340 INFO org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager [] - Clearing resource requirements of job a5ab5a452ec08cd4ac3354897f00182e 2024-01-09 09:42:42,277 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job demo1 (a5ab5a452ec08cd4ac3354897f00182e) switched from state RESTARTING to RUNNING. 2024-01-09 09:42:42,277 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - No checkpoint found during restore. 2024-01-09 09:42:42,278 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Recovering subtask 0 to checkpoint -1 for source Source: MySQL CDC Source to checkpoint. 2024-01-09 09:42:42,278 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: MySQL CDC Source -> Map -> Process -> Flat Map (1/1) (81f0b2217f899cd60a2953578f5e782a_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from CREATED to SCHEDULED. 2024-01-09 09:42:42,278 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - anonymous_datastream_source$2[3] -> ConstraintEnforcer[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_f6dc7f4d2283f4605b127b9364e21148_0_4) switched from CREATED to SCHEDULED. 2024-01-09 09:42:42,278 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - SinkMaterializer[4] -> Sink: student[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_ac517e93166644a0922111980a6172f5_0_4) switched from CREATED to SCHEDULED. 2024-01-09 09:42:42,279 INFO org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager [] - Received resource requirements from job a5ab5a452ec08cd4ac3354897f00182e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}] 2024-01-09 09:42:42,279 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: MySQL CDC Source -> Map -> Process -> Flat Map (1/1) (81f0b2217f899cd60a2953578f5e782a_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from SCHEDULED to DEPLOYING. 2024-01-09 09:42:42,279 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying Source: MySQL CDC Source -> Map -> Process -> Flat Map (1/1) (attempt #4) with attempt id 81f0b2217f899cd60a2953578f5e782a_cbc357ccb763df2852fee8c4fc7d55f2_0_4 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to container_e02_1702977012832_0303_01_000002 @ bd5 (dataPort=42286) with allocation id 706e696f295daa876866ebce50576691 2024-01-09 09:42:42,279 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - anonymous_datastream_source$2[3] -> ConstraintEnforcer[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_f6dc7f4d2283f4605b127b9364e21148_0_4) switched from SCHEDULED to DEPLOYING. 2024-01-09 09:42:42,279 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying anonymous_datastream_source$2[3] -> ConstraintEnforcer[4] (1/1) (attempt #4) with attempt id 81f0b2217f899cd60a2953578f5e782a_f6dc7f4d2283f4605b127b9364e21148_0_4 and vertex id f6dc7f4d2283f4605b127b9364e21148_0 to container_e02_1702977012832_0303_01_000002 @ bd5 (dataPort=42286) with allocation id 706e696f295daa876866ebce50576691 2024-01-09 09:42:42,281 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - SinkMaterializer[4] -> Sink: student[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_ac517e93166644a0922111980a6172f5_0_4) switched from SCHEDULED to DEPLOYING. 2024-01-09 09:42:42,281 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying SinkMaterializer[4] -> Sink: student[4] (1/1) (attempt #4) with attempt id 81f0b2217f899cd60a2953578f5e782a_ac517e93166644a0922111980a6172f5_0_4 and vertex id ac517e93166644a0922111980a6172f5_0 to container_e02_1702977012832_0303_01_000002 @ bd5 (dataPort=42286) with allocation id 706e696f295daa876866ebce50576691 2024-01-09 09:42:42,300 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: MySQL CDC Source -> Map -> Process -> Flat Map (1/1) (81f0b2217f899cd60a2953578f5e782a_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from DEPLOYING to INITIALIZING. 2024-01-09 09:42:42,303 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - anonymous_datastream_source$2[3] -> ConstraintEnforcer[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_f6dc7f4d2283f4605b127b9364e21148_0_4) switched from DEPLOYING to INITIALIZING. 2024-01-09 09:42:42,318 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - anonymous_datastream_source$2[3] -> ConstraintEnforcer[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_f6dc7f4d2283f4605b127b9364e21148_0_4) switched from INITIALIZING to RUNNING. 2024-01-09 09:42:42,319 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - SinkMaterializer[4] -> Sink: student[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_ac517e93166644a0922111980a6172f5_0_4) switched from DEPLOYING to INITIALIZING. 2024-01-09 09:42:42,341 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: MySQL CDC Source -> Map -> Process -> Flat Map (1/1) (81f0b2217f899cd60a2953578f5e782a_cbc357ccb763df2852fee8c4fc7d55f2_0_4) switched from INITIALIZING to FAILED on container_e02_1702977012832_0303_01_000002 @ bd5 (dataPort=42286). org.apache.flink.streaming.runtime.tasks.StreamTaskException: Cannot instantiate user function. at org.apache.flink.streaming.api.graph.StreamConfig.getStreamOperatorFactory(StreamConfig.java:405) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperator(OperatorChain.java:837) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperatorChain(OperatorChain.java:804) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:722) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperatorChain(OperatorChain.java:793) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:722) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperatorChain(OperatorChain.java:793) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:722) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.(OperatorChain.java:199) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.(RegularOperatorChain.java:60) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:688) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:675) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:952) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:921) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:745) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.runtime.taskmanager.Task.run(Task.java:562) ~[flink-dist-1.17.2.jar:1.17.2] at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_181] Caused by: java.lang.ClassCastException: cannot assign instance of java.lang.invoke.SerializedLambda to field org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.userFunction of type org.apache.flink.api.common.functions.Function in instance of org.apache.flink.streaming.api.operators.StreamFlatMap at java.io.ObjectStreamClass$FieldReflector.setObjFieldValues(ObjectStreamClass.java:2287) ~[?:1.8.0_181] at java.io.ObjectStreamClass.setObjFieldValues(ObjectStreamClass.java:1417) ~[?:1.8.0_181] at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2293) ~[?:1.8.0_181] at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2211) ~[?:1.8.0_181] at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2069) ~[?:1.8.0_181] at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573) ~[?:1.8.0_181] at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2287) ~[?:1.8.0_181] at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2211) ~[?:1.8.0_181] at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2069) ~[?:1.8.0_181] at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573) ~[?:1.8.0_181] at java.io.ObjectInputStream.readObject(ObjectInputStream.java:431) ~[?:1.8.0_181] at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:534) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:522) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.util.InstantiationUtil.readObjectFromConfig(InstantiationUtil.java:476) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.api.graph.StreamConfig.getStreamOperatorFactory(StreamConfig.java:389) ~[flink-dist-1.17.2.jar:1.17.2] ... 16 more 2024-01-09 09:42:42,343 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - 3 tasks will be restarted to recover the failed task 81f0b2217f899cd60a2953578f5e782a_cbc357ccb763df2852fee8c4fc7d55f2_0_4. 2024-01-09 09:42:42,343 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job demo1 (a5ab5a452ec08cd4ac3354897f00182e) switched from state RUNNING to RESTARTING. 2024-01-09 09:42:42,343 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - SinkMaterializer[4] -> Sink: student[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_ac517e93166644a0922111980a6172f5_0_4) switched from INITIALIZING to CANCELING. 2024-01-09 09:42:42,343 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - anonymous_datastream_source$2[3] -> ConstraintEnforcer[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_f6dc7f4d2283f4605b127b9364e21148_0_4) switched from RUNNING to CANCELING. 2024-01-09 09:42:42,353 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Removing registered reader after failure for subtask 0 (#4) of source Source: MySQL CDC Source. 2024-01-09 09:42:42,428 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - SinkMaterializer[4] -> Sink: student[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_ac517e93166644a0922111980a6172f5_0_4) switched from CANCELING to CANCELED. 2024-01-09 09:42:42,429 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - anonymous_datastream_source$2[3] -> ConstraintEnforcer[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_f6dc7f4d2283f4605b127b9364e21148_0_4) switched from CANCELING to CANCELED. 2024-01-09 09:42:42,430 INFO org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager [] - Clearing resource requirements of job a5ab5a452ec08cd4ac3354897f00182e 2024-01-09 09:42:43,345 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job demo1 (a5ab5a452ec08cd4ac3354897f00182e) switched from state RESTARTING to RUNNING. 2024-01-09 09:42:43,345 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - No checkpoint found during restore. 2024-01-09 09:42:43,345 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Recovering subtask 0 to checkpoint -1 for source Source: MySQL CDC Source to checkpoint. 2024-01-09 09:42:43,346 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: MySQL CDC Source -> Map -> Process -> Flat Map (1/1) (81f0b2217f899cd60a2953578f5e782a_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from CREATED to SCHEDULED. 2024-01-09 09:42:43,346 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - anonymous_datastream_source$2[3] -> ConstraintEnforcer[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_f6dc7f4d2283f4605b127b9364e21148_0_5) switched from CREATED to SCHEDULED. 2024-01-09 09:42:43,346 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - SinkMaterializer[4] -> Sink: student[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_ac517e93166644a0922111980a6172f5_0_5) switched from CREATED to SCHEDULED. 2024-01-09 09:42:43,347 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: MySQL CDC Source -> Map -> Process -> Flat Map (1/1) (81f0b2217f899cd60a2953578f5e782a_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from SCHEDULED to DEPLOYING. 2024-01-09 09:42:43,347 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying Source: MySQL CDC Source -> Map -> Process -> Flat Map (1/1) (attempt #5) with attempt id 81f0b2217f899cd60a2953578f5e782a_cbc357ccb763df2852fee8c4fc7d55f2_0_5 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to container_e02_1702977012832_0303_01_000002 @ bd5 (dataPort=42286) with allocation id 706e696f295daa876866ebce50576691 2024-01-09 09:42:43,347 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - anonymous_datastream_source$2[3] -> ConstraintEnforcer[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_f6dc7f4d2283f4605b127b9364e21148_0_5) switched from SCHEDULED to DEPLOYING. 2024-01-09 09:42:43,347 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying anonymous_datastream_source$2[3] -> ConstraintEnforcer[4] (1/1) (attempt #5) with attempt id 81f0b2217f899cd60a2953578f5e782a_f6dc7f4d2283f4605b127b9364e21148_0_5 and vertex id f6dc7f4d2283f4605b127b9364e21148_0 to container_e02_1702977012832_0303_01_000002 @ bd5 (dataPort=42286) with allocation id 706e696f295daa876866ebce50576691 2024-01-09 09:42:43,347 INFO org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager [] - Received resource requirements from job a5ab5a452ec08cd4ac3354897f00182e: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}] 2024-01-09 09:42:43,348 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - SinkMaterializer[4] -> Sink: student[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_ac517e93166644a0922111980a6172f5_0_5) switched from SCHEDULED to DEPLOYING. 2024-01-09 09:42:43,348 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying SinkMaterializer[4] -> Sink: student[4] (1/1) (attempt #5) with attempt id 81f0b2217f899cd60a2953578f5e782a_ac517e93166644a0922111980a6172f5_0_5 and vertex id ac517e93166644a0922111980a6172f5_0 to container_e02_1702977012832_0303_01_000002 @ bd5 (dataPort=42286) with allocation id 706e696f295daa876866ebce50576691 2024-01-09 09:42:43,368 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: MySQL CDC Source -> Map -> Process -> Flat Map (1/1) (81f0b2217f899cd60a2953578f5e782a_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from DEPLOYING to INITIALIZING. 2024-01-09 09:42:43,372 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - SinkMaterializer[4] -> Sink: student[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_ac517e93166644a0922111980a6172f5_0_5) switched from DEPLOYING to INITIALIZING. 2024-01-09 09:42:43,376 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - anonymous_datastream_source$2[3] -> ConstraintEnforcer[4] (1/1) (81f0b2217f899cd60a2953578f5e782a_f6dc7f4d2283f4605b127b9364e21148_0_5) switched from DEPLOYING to INITIALIZING. 2024-01-09 09:42:43,381 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: MySQL CDC Source -> Map -> Process -> Flat Map (1/1) (81f0b2217f899cd60a2953578f5e782a_cbc357ccb763df2852fee8c4fc7d55f2_0_5) switched from INITIALIZING to FAILED on container_e02_1702977012832_0303_01_000002 @ bd5 (dataPort=42286). org.apache.flink.streaming.runtime.tasks.StreamTaskException: Cannot instantiate user function. at org.apache.flink.streaming.api.graph.StreamConfig.getStreamOperatorFactory(StreamConfig.java:405) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperator(OperatorChain.java:837) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperatorChain(OperatorChain.java:804) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:722) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperatorChain(OperatorChain.java:793) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:722) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperatorChain(OperatorChain.java:793) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:722) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.OperatorChain.(OperatorChain.java:199) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.(RegularOperatorChain.java:60) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:688) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:675) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:952) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:921) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:745) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.runtime.taskmanager.Task.run(Task.java:562) ~[flink-dist-1.17.2.jar:1.17.2] at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_181] Caused by: java.lang.ClassCastException: cannot assign instance of java.lang.invoke.SerializedLambda to field org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.userFunction of type

How to reproduce

版本采用dinky1.0.0，使用整库同步功能同步mysql数据，用yarn-session模式提交任务即可复现

Anything else

此问题每次都发生，并且在沟通群里，发现很多同事也遇到此问题。

Version

1.0.0

Are you willing to submit PR?

[X] Yes I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

aiwenmo commented 10 months ago

It's a compile bug, we will fix it.

suiquantong commented 9 months ago

这个问题解决了吗？我也遇到了这个问题从mysqlcdc 到mysql 整库同步时

whmnoe4j commented 9 months ago

这个问题解决了吗？我用dinky的整库同步功能从mysqlcdc 到doris时会报这个异常。

jiyong101 commented 9 months ago

整库同步到paimon,也会报这个错误，忘尽快解决一下，或者回复一下解决方案 @aiwenmo

zackyoungh commented 9 months ago

这个问题来源已找到，缺包导致的此异常，该异常无发从JobManager看完整，请在taskmanager看全日志报错信息，新的rc4版本在flink集群上添加dinky-app.jar即可解决。以下才是真正的异常错误信息：

suiquantong commented 9 months ago

@zackyoungh 我升级到了rc4 的版本执行还有相应的错误下面是我的错误信息和lib 截图

flink 1.16.3
dinky 1.0.0 rc4

这是flink 的报错信息

2024-01-31 13:51:43
org.apache.flink.streaming.runtime.tasks.StreamTaskException: Cannot instantiate user function.
    at org.apache.flink.streaming.api.graph.StreamConfig.getStreamOperatorFactory(StreamConfig.java:399)
    at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperator(OperatorChain.java:763)
    at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperatorChain(OperatorChain.java:736)
    at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:676)
    at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperatorChain(OperatorChain.java:726)
    at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:676)
    at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperatorChain(OperatorChain.java:726)
    at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:676)
    at org.apache.flink.streaming.runtime.tasks.OperatorChain.<init>(OperatorChain.java:195)
    at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.<init>(RegularOperatorChain.java:60)
    at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:685)
    at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:672)
    at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:935)
    at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:904)
    at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:728)
    at org.apache.flink.runtime.taskmanager.Task.run(Task.java:550)
    at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ClassCastException: cannot assign instance of java.lang.invoke.SerializedLambda to field org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.userFunction of type org.apache.flink.api.common.functions.Function in instance of org.apache.flink.streaming.api.operators.StreamFlatMap
    at java.io.ObjectStreamClass$FieldReflector.setObjFieldValues(ObjectStreamClass.java:2133)
    at java.io.ObjectStreamClass.setObjFieldValues(ObjectStreamClass.java:1305)
    at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2251)
    at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2169)
    at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2027)
    at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1535)
    at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2245)
    at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2169)
    at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2027)
    at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1535)
    at java.io.ObjectInputStream.readObject(ObjectInputStream.java:422)
    at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:617)
    at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:602)
    at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:589)
    at org.apache.flink.util.InstantiationUtil.readObjectFromConfig(InstantiationUtil.java:543)
    at org.apache.flink.streaming.api.graph.StreamConfig.getStreamOperatorFactory(StreamConfig.java:383)
    ... 16 more

这是flink 的lib

cooltnt commented 8 months ago

Dinky v1.0.0 Release中仍有此错误. 需要将${dinky-home}/jar下dinky-app-1.18-1.0.0-jar-with-dependencies.jar 复制到${flinkhome}/lib下才行

suiquantong commented 8 months ago

已接受到你的信息或文件

DataLinkDC / dinky