search

dyrnq / cdc-vagrant

CDC(Change Data Capture) is made up of two components, the CDD and the CDT. CDD is stand for Change Data Detection and CDT is stand for Change Data Transfer.
https://nightlies.apache.org/flink/flink-cdc-docs-stable/
0 stars 0 forks source link

org.apache.flink.streaming.runtime.tasks.StreamTaskException: Cannot instantiate user function. #19

Open dyrnq opened 1 year ago

dyrnq commented 1 year ago 
2022-12-07 18:12:51
org.apache.flink.streaming.runtime.tasks.StreamTaskException: Cannot instantiate user function.
    at org.apache.flink.streaming.api.graph.StreamConfig.getStreamOperatorFactory(StreamConfig.java:399)
    at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperator(OperatorChain.java:763)
    at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperatorChain(OperatorChain.java:736)
    at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:676)
    at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperatorChain(OperatorChain.java:726)
    at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:676)
    at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperatorChain(OperatorChain.java:726)
    at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:676)
    at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperatorChain(OperatorChain.java:726)
    at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:676)
    at org.apache.flink.streaming.runtime.tasks.OperatorChain.<init>(OperatorChain.java:195)
    at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.<init>(RegularOperatorChain.java:60)
    at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:681)
    at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:669)
    at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:935)
    at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:904)
    at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:728)
    at org.apache.flink.runtime.taskmanager.Task.run(Task.java:550)
    at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: java.io.StreamCorruptedException: unexpected block data
    at java.base/java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1704)
    at java.base/java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2496)
    at java.base/java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2346)
    at java.base/java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2228)
    at java.base/java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1687)
    at java.base/java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2496)
    at java.base/java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2346)
    at java.base/java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2228)
    at java.base/java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1687)
    at java.base/java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2496)
    at java.base/java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2346)
    at java.base/java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2228)
    at java.base/java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1687)
    at java.base/java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2496)
    at java.base/java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2346)
    at java.base/java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2228)
    at java.base/java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1687)
    at java.base/java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2496)
    at java.base/java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2346)
    at java.base/java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2228)
    at java.base/java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1687)
    at java.base/java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2496)
    at java.base/java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2390)
    at java.base/java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2228)
    at java.base/java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1687)
    at java.base/java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2496)
    at java.base/java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2390)
    at java.base/java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2228)
    at java.base/java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1687)
    at java.base/java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2496)
    at java.base/java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2390)
    at java.base/java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2228)
    at java.base/java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1687)
    at java.base/java.io.ObjectInputStream.readObject(ObjectInputStream.java:489)
    at java.base/java.io.ObjectInputStream.readObject(ObjectInputStream.java:447)
    at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:617)
    at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:602)
    at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:589)
    at org.apache.flink.util.InstantiationUtil.readObjectFromConfig(InstantiationUtil.java:543)
    at org.apache.flink.streaming.api.graph.StreamConfig.getStreamOperatorFactory(StreamConfig.java:383)
    ... 18 more
dyrnq commented 1 year ago 
2022-12-07 18:18:04,090 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - 1 tasks will be restarted to recover the failed task 36f08037f97ef3d039dd57d6a954bde7_cbc357ccb763df2852fee8c4fc7d55f2_1_151.
2022-12-07 18:18:04,090 INFO  org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager [] - Clearing resource requirements of job f96ce316eb05e04902e00ffcc6eebfd9
2022-12-07 18:18:04,092 INFO  org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Removing registered reader after failure for subtask 1 (#151) of source Source: cdc_test_source[113].
2022-12-07 18:18:04,121 INFO  org.apache.flink.runtime.checkpoint.CheckpointCoordinator    [] - No checkpoint found during restore.
2022-12-07 18:18:04,121 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Source: cdc_test_source[113] -> DropUpdateBefore[114] -> Calc[115] -> doris_test_sink[116]: Writer -> doris_test_sink[116]: Committer (1/2) (36f08037f97ef3d039dd57d6a954bde7_cbc357ccb763df2852fee8c4fc7d55f2_0_151) switched from CREATED to SCHEDULED.
2022-12-07 18:18:04,122 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Source: cdc_test_source[113] -> DropUpdateBefore[114] -> Calc[115] -> doris_test_sink[116]: Writer -> doris_test_sink[116]: Committer (1/2) (36f08037f97ef3d039dd57d6a954bde7_cbc357ccb763df2852fee8c4fc7d55f2_0_151) switched from SCHEDULED to DEPLOYING.
2022-12-07 18:18:04,122 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Deploying Source: cdc_test_source[113] -> DropUpdateBefore[114] -> Calc[115] -> doris_test_sink[116]: Writer -> doris_test_sink[116]: Committer (1/2) (attempt #151) with attempt id 36f08037f97ef3d039dd57d6a954bde7_cbc357ccb763df2852fee8c4fc7d55f2_0_151 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 192.168.56.116:9267-93cc4c @ vm116 (dataPort=15041) with allocation id e60f55ca16b499320e5a7af958a71f53
2022-12-07 18:18:04,122 INFO  org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager [] - Received resource requirements from job f96ce316eb05e04902e00ffcc6eebfd9: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
2022-12-07 18:18:04,122 INFO  org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Recovering subtask 0 to checkpoint -1 for source Source: cdc_test_source[113] to checkpoint.
2022-12-07 18:18:04,138 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Source: cdc_test_source[113] -> DropUpdateBefore[114] -> Calc[115] -> doris_test_sink[116]: Writer -> doris_test_sink[116]: Committer (1/2) (36f08037f97ef3d039dd57d6a954bde7_cbc357ccb763df2852fee8c4fc7d55f2_0_151) switched from DEPLOYING to INITIALIZING.
2022-12-07 18:18:04,205 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Source: cdc_test_source[113] -> DropUpdateBefore[114] -> Calc[115] -> doris_test_sink[116]: Writer -> doris_test_sink[116]: Committer (1/2) (36f08037f97ef3d039dd57d6a954bde7_cbc357ccb763df2852fee8c4fc7d55f2_0_151) switched from INITIALIZING to FAILED on 192.168.56.116:9267-93cc4c @ vm116 (dataPort=15041).
dyrnq commented 1 year ago

may be lost flink-doris-connector jar or may be flink cluster need restart.