[SUPPORT]flink hudi api use batch insert data happen error

Tips before filing an issue

Have you gone through our FAQs? yes
Join the mailing list to engage in conversations and get faster support at dev-subscribe@hudi.apache.org.
If you have triaged this as a bug, then file an issue directly.

Describe the problem you faced

A clear and concise description of the problem.

To Reproduce

Steps to reproduce the behavior:

1.use the The following code

import com.yuou.flinkhudi.util.HudiHandler import com.yuou.flinkhudi.util.flink.FlinkUtils import com.yuou.flinkhudi.util.flink.dwd.source.ReaderCustomerMerchantInfoource.{createTablesql, env, tableEnv} import org.apache.flink.streaming.api.functions.sink.filesystem.BucketWriter import org.apache.flink.streaming.api.scala.StreamExecutionEnvironment import org.apache.flink.table.api.bridge.scala.{StreamTableEnvironment, table2RowDataStream} import org.apache.hudi.client.HoodieFlinkWriteClient import org.apache.hudi.config.HoodieCompactionConfig import org.apache.hudi.configuration.FlinkOptions

/**

生成国家编码测试数据
@author zhujh
@date 2021-09-18 */ object ContryAreaCodeData {

private var env: StreamExecutionEnvironment = null private var tableEnv: StreamTableEnvironment = null private var createTablesql: String = ""

/**
- 生成国家区域编码数据 */ def generateContryAreaCodeData(): Unit = {
System.setProperty("HADOOP_USER_NAME", "dops") System.setProperty("hadoop.home.dir", "D:\共享目录\development\SDK\hadoop-2.7.7") env = FlinkUtils.getStreamExecutionEnviromentInstance() //assert(null == env) tableEnv = FlinkUtils.getStreamTableEnviromentInstance(env) // access flink configuration val configuration = tableEnv.getConfig().getConfiguration() // set low-level key-value options // set execution.result-mode=tableau; //set execution.checkpointing.interval=10sec; configuration.setString("execution.result-mode", "tableau") configuration.setString("execution.checkpointing.interval", "10sec") //assert(null == tableEnv) //在table上下文创建表

createTablesql = """ |CREATE TABLE configure_area( | id int PRIMARY KEY NOT ENFORCED COMMENT 'ID,主键', | code varchar(128) COMMENT '编码', | name varchar(128) COMMENT '名称', | parent_code varchar(128) COMMENT '父级编码', | level int COMMENT '层级【0-根，1-国家，2-省，3-市，4-区，5-街道】', | full_name varchar(255) COMMENT '全名称（省-市-区-街道）', | sap_code varchar(128) COMMENT 'SAP编码', | remark varchar(255) COMMENT '备注', | status varchar(10) COMMENT '状态：【ENABLE-启用，DISABLE-禁用', | create_by varchar(50) COMMENT '创建人编码', | create_time TIMESTAMP(0) COMMENT '创建时间', | update_by varchar(50) COMMENT '修改人编码', | update_time TIMESTAMP(0) COMMENT '修改时间', | is_deleted int COMMENT '是否删除：【0-否，1-是' |) |WITH ( | 'connector' = 'hudi', | 'path' = 'file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area', | 'table.type' = 'COPY_ON_WRITE', -- this creates a MERGE_ON_READ table, by default is COPY_ON_WRI | 'write.precombine.field' = 'id', | 'hoodie.datasource.write.keygenerator.class' = 'org.apache.hudi.NonpartitionedKeyGenerator', | 'metadata.compaction.delta_commits' = '1' |) """.stripMargin

HudiHandler.createTable(tableEnv, createTablesql) tableEnv.executeSql( """ |insert into configure_area values |(1,'1','中国','0',1,'中国','sap_area','','ENABLE','zhangsan',TIMESTAMP '2021-09-18 16:48:00','ayj',TIMESTAMP '2021-09-18 16:48:00',0) |""".stripMargin)

tableEnv.executeSql("insert into configure_area values(2,'2','四川','1',2,'中国-四川','sap_area','','ENABLE','lisi',TIMESTAMP '2021-09-18 16:47:00','ayj',TIMESTAMP '2021-09-18 16:48:00',0)")

tableEnv.executeSql("insert into configure_area values(3,'3','成都','2',3" + ",'中国-四川-成都','sap_area','','ENABLE','liuwu'" + ",TIMESTAMP '2021-09-18 16:49:00','liuwu',TIMESTAMP '2021-09-18 16:49:00',0)") tableEnv.executeSql("insert into configure_area values(4,'4','锦江区','3',4" + ",'中国-四川-成都-锦江区','sap_area','','ENABLE','qiqi'" + ",TIMESTAMP '2021-09-18 16:50:00','qiqi',TIMESTAMP '2021-09-18 16:50:00',0)")

tableEnv.executeSql( "select * from configure_area").print()

env.execute("ContryAreaCodeData") }

def main(args: Array[String]): Unit = { generateContryAreaCodeData() }

}

Run the above code to query the table ，arise the error

3.pom文件

FlinkOperateHudi

<properties>
    <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
    <maven.compiler.source>1.8</maven.compiler.source>
    <maven.compiler.target>1.8</maven.compiler.target>
    <flink.version>1.12.1</flink.version>
</properties>

<dependencies>
    <!-- Flink操作Hudi需要的包-->
    <dependency>
        <groupId>org.apache.hudi</groupId>
        <artifactId>hudi-flink-bundle_2.11</artifactId>
        <version>0.9.0</version>
    </dependency>

    <dependency>
        <groupId>org.apache.flink</groupId>
        <artifactId>flink-clients_2.11</artifactId>
        <version>${flink.version}</version>
    </dependency>

    <!-- java 开发Flink所需依赖 -->
    <dependency>
        <groupId>org.apache.flink</groupId>
        <artifactId>flink-java</artifactId>
        <version>${flink.version}</version>
    </dependency>
    <dependency>
        <groupId>org.apache.flink</groupId>
        <artifactId>flink-streaming-java_2.11</artifactId>
        <version>${flink.version}</version>
    </dependency>

    <!-- Flink 开发Scala需要导入以下依赖 -->
    <dependency>
        <groupId>org.apache.flink</groupId>
        <artifactId>flink-scala_2.11</artifactId>
        <version>${flink.version}</version>
        <!--<scope>provided</scope>-->
    </dependency>
    <dependency>
        <groupId>org.apache.flink</groupId>
        <artifactId>flink-streaming-scala_2.11</artifactId>
        <version>${flink.version}</version>
    </dependency>

    <!-- 读取hdfs文件需要jar包-->
    <dependency>
    <groupId>org.apache.hadoop</groupId>
    <artifactId>hadoop-client</artifactId>
    <version>2.9.2</version>
    </dependency>
    <!-- Flink 状态管理 RocksDB 依赖 -->
    <dependency>
        <groupId>org.apache.flink</groupId>
        <artifactId>flink-statebackend-rocksdb_2.11</artifactId>
        <version>${flink.version}</version>
    </dependency>

    <!-- Flink Kafka连接器的依赖 -->
    <dependency>
        <groupId>org.apache.flink</groupId>
        <artifactId>flink-connector-kafka_2.11</artifactId>
        <version>${flink.version}</version>
    </dependency>

    <dependency>
        <groupId>org.apache.flink</groupId>
        <artifactId>flink-csv</artifactId>
        <version>1.12.1</version>
    </dependency>
    <!-- Flink  HDFS Sink-->
    <!--<dependency>-->
    <!--<groupId>org.apache.flink</groupId>-->
    <!--<artifactId>flink-connector-filesystem_2.11</artifactId>-->
    <!--<version>${flink.version}</version>-->
    <!--</dependency>-->

    <!-- Flink SQL & Table-->
    <dependency>
        <groupId>org.apache.flink</groupId>
        <artifactId>flink-table-planner_2.11</artifactId>
        <version>${flink.version}</version>
    </dependency>
    <dependency>
        <groupId>org.apache.flink</groupId>
        <artifactId>flink-table-api-scala-bridge_2.11</artifactId>
        <version>${flink.version}</version>
    </dependency>

    <!-- Flink SQL中使用Blink 需要导入的包-->
    <dependency>
        <groupId>org.apache.flink</groupId>
        <artifactId>flink-table-planner-blink_2.11</artifactId>
        <version>${flink.version}</version>
    </dependency>
    <dependency>
        <groupId>org.projectlombok</groupId>
        <artifactId>lombok</artifactId>
        <version>1.16.16</version><!--版本号自己选一个就行-->
    </dependency>
</dependencies>

Expected behavior

A clear and concise description of what you expected to happen.

Environment Description

Hudi version :0.9
FLINK 1.12.1
Spark version :
Hive version :
Hadoop version :
Storage (HDFS/S3/GCS..) :
Running on Docker? (yes/no) :no

Additional context

Add any other context about the problem here.

Stacktrace

Add the stacktrace of the error.

Exception in thread "main" org.apache.hudi.exception.HoodieException: Get table avro schema error at org.apache.hudi.table.HoodieTableSource.getInputFormat(HoodieTableSource.java:322) at org.apache.hudi.table.HoodieTableSource.getInputFormat(HoodieTableSource.java:302) at org.apache.hudi.table.HoodieTableSource$1.produceDataStream(HoodieTableSource.java:190) at org.apache.flink.table.planner.plan.nodes.common.CommonPhysicalTableSourceScan.createSourceTransformation(CommonPhysicalTableSourceScan.scala:88) at org.apache.flink.table.planner.plan.nodes.physical.stream.StreamExecTableSourceScan.translateToPlanInternal(StreamExecTableSourceScan.scala:91) at org.apache.flink.table.planner.plan.nodes.physical.stream.StreamExecTableSourceScan.translateToPlanInternal(StreamExecTableSourceScan.scala:44) at org.apache.flink.table.planner.plan.nodes.exec.ExecNode$class.translateToPlan(ExecNode.scala:59) at org.apache.flink.table.planner.plan.nodes.physical.stream.StreamExecTableSourceScan.translateToPlan(StreamExecTableSourceScan.scala:44) at org.apache.flink.table.planner.plan.nodes.physical.stream.StreamExecLegacySink.translateToTransformation(StreamExecLegacySink.scala:158) at org.apache.flink.table.planner.plan.nodes.physical.stream.StreamExecLegacySink.translateToPlanInternal(StreamExecLegacySink.scala:82) at org.apache.flink.table.planner.plan.nodes.physical.stream.StreamExecLegacySink.translateToPlanInternal(StreamExecLegacySink.scala:48) at org.apache.flink.table.planner.plan.nodes.exec.ExecNode$class.translateToPlan(ExecNode.scala:59) at org.apache.flink.table.planner.plan.nodes.physical.stream.StreamExecLegacySink.translateToPlan(StreamExecLegacySink.scala:48) at org.apache.flink.table.planner.delegation.StreamPlanner$$anonfun$translateToPlan$1.apply(StreamPlanner.scala:66) at org.apache.flink.table.planner.delegation.StreamPlanner$$anonfun$translateToPlan$1.apply(StreamPlanner.scala:65) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234) at scala.collection.Iterator$class.foreach(Iterator.scala:891) at scala.collection.AbstractIterator.foreach(Iterator.scala:1334) at scala.collection.IterableLike$class.foreach(IterableLike.scala:72) at scala.collection.AbstractIterable.foreach(Iterable.scala:54) at scala.collection.TraversableLike$class.map(TraversableLike.scala:234) at scala.collection.AbstractTraversable.map(Traversable.scala:104) at org.apache.flink.table.planner.delegation.StreamPlanner.translateToPlan(StreamPlanner.scala:65) at org.apache.flink.table.planner.delegation.PlannerBase.translate(PlannerBase.scala:167) at org.apache.flink.table.api.internal.TableEnvironmentImpl.translate(TableEnvironmentImpl.java:1329) at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:707) at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeOperation(TableEnvironmentImpl.java:1107) at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeSql(TableEnvironmentImpl.java:666) at com.yuou.flinkhudi.util.flink.dwd.generate.ContryAreaCodeData$.generateContryAreaCodeData(ContryAreaCodeData.scala:91) at com.yuou.flinkhudi.util.flink.dwd.generate.ContryAreaCodeData$.main(ContryAreaCodeData.scala:99) at com.yuou.flinkhudi.util.flink.dwd.generate.ContryAreaCodeData.main(ContryAreaCodeData.scala) Caused by: org.apache.hudi.exception.InvalidTableException: Invalid Hoodie Table. file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area at org.apache.hudi.common.table.TableSchemaResolver.lambda$getTableParquetSchemaFromDataFile$0(TableSchemaResolver.java:88) at org.apache.hudi.common.util.Option.orElseThrow(Option.java:123) at org.apache.hudi.common.table.TableSchemaResolver.getTableParquetSchemaFromDataFile(TableSchemaResolver.java:88) at org.apache.hudi.common.table.TableSchemaResolver.getTableAvroSchemaFromDataFile(TableSchemaResolver.java:153) at org.apache.hudi.common.table.TableSchemaResolver.getTableAvroSchema(TableSchemaResolver.java:187) at org.apache.hudi.common.table.TableSchemaResolver.getTableAvroSchema(TableSchemaResolver.java:163) at org.apache.hudi.table.HoodieTableSource.getInputFormat(HoodieTableSource.java:320)

It seems that you do not write your data successfully, can you show your files in .hoodie directory.

No successful commits.

Can you show the log of JobManager ?

0:33:59,268 INFO org.apache.hudi.table.HoodieTableFactory - Table option [hoodie.datasource.write.keygenerator.class] is reset to org.apache.hudi.keygen.NonpartitionedAvroKeyGenerator because this is a non-partitioned table 10:34:01,444 INFO org.apache.flink.api.java.typeutils.TypeExtractor - class org.apache.hudi.common.model.HoodieRecord does not contain a setter for field key 10:34:01,444 INFO org.apache.flink.api.java.typeutils.TypeExtractor - Class class org.apache.hudi.common.model.HoodieRecord cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance. 10:34:01,464 INFO org.apache.flink.api.java.typeutils.TypeExtractor - class org.apache.hudi.common.model.HoodieRecord does not contain a setter for field key 10:34:01,464 INFO org.apache.flink.api.java.typeutils.TypeExtractor - Class class org.apache.hudi.common.model.HoodieRecord cannot be used as a POJO type because not all fields are valid POJO fields, and must be processed as GenericType. Please read the Flink documentation on "Data Types & Serialization" for details of the effect on performance. 10:34:01,709 INFO org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils - The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value. 10:34:01,709 INFO org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils - The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value. 10:34:01,709 INFO org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils - The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value. 10:34:01,710 INFO org.apache.flink.runtime.taskexecutor.TaskE

10:34:04,886 INFO io.javalin.Javalin 10:34:05,041 INFO io.javalin.Javalin 10:34:05,042 INFO io.javalin.Javalin 10:34:05,042 INFO org.apache.hudi.timeline.service.TimelineService 10:34:05,042 INFO org.apache.hudi.client.embedded.EmbeddedTimelineService 10:34:05,070 INFO org.apache.hudi.common.table.HoodieTableMetaClient 10:34:05,096 INFO org.apache.hudi.common.table.HoodieTableMetaClient 10:34:05,107 INFO org.apache.hudi.common.table.HoodieTableConfig 10:34:05,113 INFO org.apache.hudi.common.table.HoodieTableMetaClient 10:34:05,114 INFO org.apache.hudi.common.table.HoodieTableMetaClient 10:34:05,114 INFO org.apache.hudi.util.StreamerUtil 10:34:05,114 INFO org.apache.flink.runtime.jobmaster.JobMaster 10:34:05,115 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,124 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,124 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,124 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,124 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,124 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,125 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,125 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,125 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,125 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,125 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,125 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,125 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,125 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,125 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,125 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,125 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,125 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,125 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,125 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,125 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,125 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,125 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,139 INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl 10:34:05,142 INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl 10:34:05,142 INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl 10:34:05,142 INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl 10:34:05,143 INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl 10:34:05,143 INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl 10:34:05,143 INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl 10:34:05,143 INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl 10:34:05,151 INFO org.apache.flink.runtime.highavailability.nonha.emb 10:34:05,151 INFO org.apache.flink.runtime.jobmaster.JobMaster 10:34:05,155 INFO org.apache.flink.runtime.jobmaster.JobMaster 10:34:05,158 INFO org.apache.flink.runtime.resourcemanager.Standalone 10:34:05,166 INFO org.apache.flink.runtime.resourcemanager.Standalone 10:34:05,168 INFO org.apache.flink.runtime.jobmaster.JobMaster 10:34:05,169 INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl 10:34:05,170 INFO org.apache.flink.runtime.resourcemanager.Standalone 10:34:05,170 INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl 10:34:05,170 INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl 10:34:05,171 INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl 10:34:05,171 INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl 10:34:05,171 INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl 10:34:05,172 INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl 10:34:05,172 INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl 10:34:05,174 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,176 INFO org.apache.flink.runtime.resourcemanager.Standalone 10:34:05,176 INFO org.apache.flink.runtime.resourcemanager.Standalone 10:34:05,176 INFO org.apache.flink.runtime.resourcemanager.Standalone 10:34:05,178 INFO org.apache.flink.runtime.resourcemanager.Standalone 10:34:05,178 INFO org.apache.flink.runtime.resourcemanager.Standalone 10:34:05,179 INFO org.apache.flink.runtime.resourcemanager.Standalone 10:34:05,179 INFO org.apache.flink.runtime.resourcemanager.Standalone 10:34:05,183 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,185 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService 10:34:05,188 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService 10:34:05,189 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,189 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,190 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,190 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,190 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,190 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,190 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,190 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService 10:34:05,191 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,191 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,191 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,191 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,191 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,191 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,191 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,195 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService 10:34:05,196 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,200 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,213 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,216 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,222 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,223 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,224 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl 10:34:05,225 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,225 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,225 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,225 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,226 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,226 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,227 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,227 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,227 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,227 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,227 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,227 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,227 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,227 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,228 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,228 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,229 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,229 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,229 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,229 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,229 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,229 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,229 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,229 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,229 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,229 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,229 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,230 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,230 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,230 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,230 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,230 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,231 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,231 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,231 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,231 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,231 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,231 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,231 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,232 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,249 INFO org.apache.hudi.table.HoodieTableFactory 10:34:05,283 INFO org.apache.hudi.common.table.HoodieTableMetaClient 10:34:05,300 INFO org.apache.hudi.common.table.HoodieTableConfig 10:34:05,303 INFO org.apache.hudi.common.table.HoodieTableMetaClient 10:34:05,306 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,307 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,310 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl 10:34:05,316 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,318 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,320 INFO org.apache.hadoop.conf.Configuration.deprecation 10:34:05,328 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,328 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,329 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl 10:34:05,329 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,331 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,334 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,335 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl 10:34:05,335 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,336 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,337 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,339 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,340 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,340 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl 10:34:05,341 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,342 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,345 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,345 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,346 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,346 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl 10:34:05,347 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,351 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,352 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl 10:34:05,352 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,353 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,354 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,359 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,360 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl 10:34:05,361 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,362 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,363 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,365 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,366 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl 10:34:05,366 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,367 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,368 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,371 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,371 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl 10:34:05,373 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,373 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,373 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl 10:34:05,374 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,373 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,375 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,375 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,376 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,377 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,377 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,376 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,377 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,378 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,378 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,378 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,376 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,379 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,379 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,379 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,379 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,379 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,379 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,380 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,379 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,380 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl 10:34:05,378 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,384 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,385 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,385 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,385 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl 10:34:05,385 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,386 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,382 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,386 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,387 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,388 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,388 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,388 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl 10:34:05,388 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,388 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,389 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,391 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,393 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,394 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,395 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,395 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,395 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,395 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,395 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,395 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,396 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl 10:34:05,397 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,398 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,398 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,401 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,401 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,401 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,402 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,403 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,401 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,404 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,404 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,404 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl 10:34:05,405 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,405 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,404 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,404 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,404 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,407 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,407 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,406 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,405 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,405 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,405 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,408 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,409 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,408 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,409 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,408 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,407 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,410 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,407 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl 10:34:05,409 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,412 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,412 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,413 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,413 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,414 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,414 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,414 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,414 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,415 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,415 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,415 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,415 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,415 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,414 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,416 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,416 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,416 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,417 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,417 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,417 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl 10:34:05,417 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,418 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,418 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,420 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,421 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,422 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl 10:34:05,423 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,423 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,424 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,424 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,424 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl 10:34:05,427 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor 10:34:05,427 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,428 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,425 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,428 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,429 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,427 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl 10:34:05,427 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,433 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,434 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,434 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,434 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,434 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,432 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,435 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,430 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,437 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,438 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph 10:34:05,439 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,440 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,440 INFO org.apache.flink.streaming.runtime.tasks.StreamTask 10:34:05,440 INFO org.apache.flink.runtime.taskmanager.Task 10:34:05,439 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Starting Javalin ... - Listening on http://localhost:65426/ - Javalin started in 160ms \o/ - Starting Timeline server on port :65426 - Started embedded timeline server at 0.0.0.0:65426 - Initializing file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area as hoodie table file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area - Loading HoodieTableMetaClient from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area - Loading table properties from file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/hoodie.properties - Finished Loading Table of type COPY_ON_WRITE(version=1, baseFileFormat=PARQUET) from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area - Finished initializing Table of type COPY_ON_WRITE from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area - Table initialized under base path file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area - Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy] - Job insert-into_default_catalog.default_database.configure_area (63fd2fc9f76ebcbf9b7d3d47dabbdf38) switched from state CREATED to RUNNING. - Source: Values(tuples=[[{ 1, _UTF-16LE'1', _UTF-16LE'中国', _UTF-16LE'0', 1, _UTF-16LE'中国', _UTF-16LE'sap_area', _UTF-16LE'', _UTF-16LE'ENABLE', _UTF-16LE'zhangsan', 2021-09-18 16:48:00, _UTF-16LE'ayj', 2021-09-18 16:48:00, 0 }]]) (1/1) (6a4bc3af8b2ff4a559b4ea525d82672f) switched from CREATED to SCHEDULED. - Filter -> Map (1/8) (921bd3faa6059f2011630dc6c7cf6205) switched from CREATED to SCHEDULED. - Filter -> Map (2/8) (2f7ff7feae62ead6c95de8adcbae446f) switched from CREATED to SCHEDULED. - Filter -> Map (3/8) (f55cea56f6c92ae6431d74d60038df8d) switched from CREATED to SCHEDULED. - Filter -> Map (4/8) (7d03b476ed15f492d5f2b3b6fd6d70a5) switched from CREATED to SCHEDULED. - Filter -> Map (5/8) (7c2e16589f48980e9d1a98b2e7657812) switched from CREATED to SCHEDULED. - Filter -> Map (6/8) (1167445b24e5d29a6b9ed39e64ae8b7b) switched from CREATED to SCHEDULED. - Filter -> Map (7/8) (54a81f66851c0dd2941a3f803d219748) switched from CREATED to SCHEDULED. - Filter -> Map (8/8) (4cbc4b54611bc044378ef998f3684352) switched from CREATED to SCHEDULED. - bucket_assigner (1/8) (1377c78b753cc343c4d864a472276ed9) switched from CREATED to SCHEDULED. - bucket_assigner (2/8) (991aeded53c2b1faea239c5f09c0f7ba) switched from CREATED to SCHEDULED. - bucket_assigner (3/8) (84bcfbf44e9fa5c3877d1d4a9c0e40e1) switched from CREATED to SCHEDULED. - bucket_assigner (4/8) (f2738a17abb5e3b94d2aa4afc3982bfb) switched from CREATED to SCHEDULED. - bucket_assigner (5/8) (ba6f95731e0e4f8bf6748ce3cae87a70) switched from CREATED to SCHEDULED. - bucket_assigner (6/8) (d4aeffa74f82b79361f229cb61dbc990) switched from CREATED to SCHEDULED. - bucket_assigner (7/8) (cd6ba8fe96b84e26c7a0e9a0999a9e0c) switched from CREATED to SCHEDULED. - bucket_assigner (8/8) (f55f88d3e637e42da3463df5ef5332a7) switched from CREATED to SCHEDULED. - hoodie_stream_write (1/4) (888768308836b8f4831890fa2934fe2c) switched from CREATED to SCHEDULED. - hoodie_stream_write (2/4) (d48422b9607bf34237abcaf9cbca24a2) switched from CREATED to SCHEDULED. - hoodie_stream_write (3/4) (ff5491c88ffc17a816e22c29b6da47be) switched from CREATED to SCHEDULED. - hoodie_stream_write (4/4) (5e2085d96585101e586a7ea47bc56a98) switched from CREATED to SCHEDULED. - Sink: clean_commits (1/1) (e46f7227496a98cb8360e4afa2fcdca1) switched from CREATED to SCHEDULED. - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{8cabae95a0cc26237237c745f62b5fd4}] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{4d7d73d1ad0a98376062a8d00ffcfe2c}] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{3a96f5b7ee954f478c94e032ac8a4255}] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{753d3ff5249b759c470280103571c7a6}] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{176fb8ec4ea792945531ee45b5e6554d}] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{f64a6edd16f8bafec0d0efbb24a6f8cb}] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{035d934255cdf2a7c4e82c5bd739d3a3}] - Cannot serve slot request, no ResourceManager connected. Adding as pending request [SlotRequestId{eb76c87c540d933538f46f610219904d}] edded.EmbeddedLeaderService - Received confirmation of leadership for leader akka://flink/user/rpc/jobmanager_3 , session=4cbfe032-ce86-4978-a671-074d4eb6f1e0 - Connecting to ResourceManager akka://flink/user/rpc/resourcemanager_1(8adbc1f5acdcf998575e8775440343d9) - Resolved ResourceManager address, beginning registration ResourceManager - Registering job manager a671074d4eb6f1e04cbfe032ce864978@akka://flink/user/rpc/jobmanager_3 for job 63fd2fc9f76ebcbf9b7d3d47dabbdf38. ResourceManager - Registered job manager a671074d4eb6f1e04cbfe032ce864978@akka://flink/user/rpc/jobmanager_3 for job 63fd2fc9f76ebcbf9b7d3d47dabbdf38. - JobManager successfully registered at ResourceManager, leader id: 8adbc1f5acdcf998575e8775440343d9. - Requesting new slot [SlotRequestId{8cabae95a0cc26237237c745f62b5fd4}] and profile ResourceProfile{UNKNOWN} with allocation id 764034c3267a443562b693e46aad20e5 from resource manager. ResourceManager - Request slot with profile ResourceProfile{UNKNOWN} for job 63fd2fc9f76ebcbf9b7d3d47dabbdf38 with allocation id 764034c3267a443562b693e46aad20e5. - Requesting new slot [SlotRequestId{4d7d73d1ad0a98376062a8d00ffcfe2c}] and profile ResourceProfile{UNKNOWN} with allocation id 21a45995954d4f80f8e9559bd6c050c2 from resource manager. - Requesting new slot [SlotRequestId{3a96f5b7ee954f478c94e032ac8a4255}] and profile ResourceProfile{UNKNOWN} with allocation id 4a41e5491be9026da0456dd23f0709e4 from resource manager. - Requesting new slot [SlotRequestId{753d3ff5249b759c470280103571c7a6}] and profile ResourceProfile{UNKNOWN} with allocation id bc89ec13c8cfe5f30f33b9b92894ad6d from resource manager. - Requesting new slot [SlotRequestId{176fb8ec4ea792945531ee45b5e6554d}] and profile ResourceProfile{UNKNOWN} with allocation id 3b5cadd7193ba9bd4dc2cf7ccc9667b2 from resource manager. - Requesting new slot [SlotRequestId{f64a6edd16f8bafec0d0efbb24a6f8cb}] and profile ResourceProfile{UNKNOWN} with allocation id 69e4facaa72255fa4011ad886be6e830 from resource manager. - Requesting new slot [SlotRequestId{035d934255cdf2a7c4e82c5bd739d3a3}] and profile ResourceProfile{UNKNOWN} with allocation id 45b2be58c17c46712a1f99ffb71124c0 from resource manager. - Requesting new slot [SlotRequestId{eb76c87c540d933538f46f610219904d}] and profile ResourceProfile{UNKNOWN} with allocation id f738d448f48642d75b3bf69475df9c0a from resource manager. - Receive slot request 764034c3267a443562b693e46aad20e5 for job 63fd2fc9f76ebcbf9b7d3d47dabbdf38 from resource manager with leader id 8adbc1f5acdcf998575e8775440343d9. ResourceManager - Request slot with profile ResourceProfile{UNKNOWN} for job 63fd2fc9f76ebcbf9b7d3d47dabbdf38 with allocation id 21a45995954d4f80f8e9559bd6c050c2. ResourceManager - Request slot with profile ResourceProfile{UNKNOWN} for job 63fd2fc9f76ebcbf9b7d3d47dabbdf38 with allocation id 4a41e5491be9026da0456dd23f0709e4. ResourceManager - Request slot with profile ResourceProfile{UNKNOWN} for job 63fd2fc9f76ebcbf9b7d3d47dabbdf38 with allocation id bc89ec13c8cfe5f30f33b9b92894ad6d. ResourceManager - Request slot with profile ResourceProfile{UNKNOWN} for job 63fd2fc9f76ebcbf9b7d3d47dabbdf38 with allocation id 3b5cadd7193ba9bd4dc2cf7ccc9667b2. ResourceManager - Request slot with profile ResourceProfile{UNKNOWN} for job 63fd2fc9f76ebcbf9b7d3d47dabbdf38 with allocation id 69e4facaa72255fa4011ad886be6e830. ResourceManager - Request slot with profile ResourceProfile{UNKNOWN} for job 63fd2fc9f76ebcbf9b7d3d47dabbdf38 with allocation id 45b2be58c17c46712a1f99ffb71124c0. ResourceManager - Request slot with profile ResourceProfile{UNKNOWN} for job 63fd2fc9f76ebcbf9b7d3d47dabbdf38 with allocation id f738d448f48642d75b3bf69475df9c0a. - Allocated slot for 764034c3267a443562b693e46aad20e5. - Add job 63fd2fc9f76ebcbf9b7d3d47dabbdf38 for job leader monitoring. - Try to register at job manager akka://flink/user/rpc/jobmanager_3 with leader id 4cbfe032-ce86-4978-a671-074d4eb6f1e0. - Receive slot request 21a45995954d4f80f8e9559bd6c050c2 for job 63fd2fc9f76ebcbf9b7d3d47dabbdf38 from resource manager with leader id 8adbc1f5acdcf998575e8775440343d9. - Allocated slot for 21a45995954d4f80f8e9559bd6c050c2. - Receive slot request 4a41e5491be9026da0456dd23f0709e4 for job 63fd2fc9f76ebcbf9b7d3d47dabbdf38 from resource manager with leader id 8adbc1f5acdcf998575e8775440343d9. - Allocated slot for 4a41e5491be9026da0456dd23f0709e4. - Receive slot request bc89ec13c8cfe5f30f33b9b92894ad6d for job 63fd2fc9f76ebcbf9b7d3d47dabbdf38 from resource manager with leader id 8adbc1f5acdcf998575e8775440343d9. - Allocated slot for bc89ec13c8cfe5f30f33b9b92894ad6d. - Receive slot request 3b5cadd7193ba9bd4dc2cf7ccc9667b2 for job 63fd2fc9f76ebcbf9b7d3d47dabbdf38 from resource manager with leader id 8adbc1f5acdcf998575e8775440343d9. - Resolved JobManager address, beginning registration - Allocated slot for 3b5cadd7193ba9bd4dc2cf7ccc9667b2. - Receive slot request 69e4facaa72255fa4011ad886be6e830 for job 63fd2fc9f76ebcbf9b7d3d47dabbdf38 from resource manager with leader id 8adbc1f5acdcf998575e8775440343d9. - Allocated slot for 69e4facaa72255fa4011ad886be6e830. - Receive slot request 45b2be58c17c46712a1f99ffb71124c0 for job 63fd2fc9f76ebcbf9b7d3d47dabbdf38 from resource manager with leader id 8adbc1f5acdcf998575e8775440343d9. - Allocated slot for 45b2be58c17c46712a1f99ffb71124c0. - Receive slot request f738d448f48642d75b3bf69475df9c0a for job 63fd2fc9f76ebcbf9b7d3d47dabbdf38 from resource manager with leader id 8adbc1f5acdcf998575e8775440343d9. - Allocated slot for f738d448f48642d75b3bf69475df9c0a. - Successful registration at job manager akka://flink/user/rpc/jobmanager_3 for job 63fd2fc9f76ebcbf9b7d3d47dabbdf38. - Establish JobManager connection for job 63fd2fc9f76ebcbf9b7d3d47dabbdf38. - Offer reserved slots to the leader of job 63fd2fc9f76ebcbf9b7d3d47dabbdf38. - Source: Values(tuples=[[{ 1, _UTF-16LE'1', _UTF-16LE'中国', _UTF-16LE'0', 1, _UTF-16LE'中国', _UTF-16LE'sap_area', _UTF-16LE'', _UTF-16LE'ENABLE', _UTF-16LE'zhangsan', 2021-09-18 16:48:00, _UTF-16LE'ayj', 2021-09-18 16:48:00, 0 }]]) (1/1) (6a4bc3af8b2ff4a559b4ea525d82672f) switched from SCHEDULED to DEPLOYING. - Deploying Source: Values(tuples=[[{ 1, _UTF-16LE'1', _UTF-16LE'中国', _UTF-16LE'0', 1, _UTF-16LE'中国', _UTF-16LE'sap_area', _UTF-16LE'', _UTF-16LE'ENABLE', _UTF-16LE'zhangsan', 2021-09-18 16:48:00, _UTF-16LE'ayj', 2021-09-18 16:48:00, 0 }]]) (1/1) (attempt #0) with attempt id 6a4bc3af8b2ff4a559b4ea525d82672f to a6e88966-162b-44b4-b2fd-39461a1a440c @ 127.0.0.1 (dataPort=-1) with allocation id 21a45995954d4f80f8e9559bd6c050c2 - Filter -> Map (1/8) (921bd3faa6059f2011630dc6c7cf6205) switched from SCHEDULED to DEPLOYING. - Deploying Filter -> Map (1/8) (attempt #0) with attempt id 921bd3faa6059f2011630dc6c7cf6205 to a6e88966-162b-44b4-b2fd-39461a1a440c @ 127.0.0.1 (dataPort=-1) with allocation id 21a45995954d4f80f8e9559bd6c050c2 - Activate slot 21a45995954d4f80f8e9559bd6c050c2. - Filter -> Map (2/8) (2f7ff7feae62ead6c95de8adcbae446f) switched from SCHEDULED to DEPLOYING. - Deploying Filter -> Map (2/8) (attempt #0) with attempt id 2f7ff7feae62ead6c95de8adcbae446f to a6e88966-162b-44b4-b2fd-39461a1a440c @ 127.0.0.1 (dataPort=-1) with allocation id 69e4facaa72255fa4011ad886be6e830 - Filter -> Map (3/8) (f55cea56f6c92ae6431d74d60038df8d) switched from SCHEDULED to DEPLOYING. - Deploying Filter -> Map (3/8) (attempt #0) with attempt id f55cea56f6c92ae6431d74d60038df8d to a6e88966-162b-44b4-b2fd-39461a1a440c @ 127.0.0.1 (dataPort=-1) with allocation id f738d448f48642d75b3bf69475df9c0a - Filter -> Map (4/8) (7d03b476ed15f492d5f2b3b6fd6d70a5) switched from SCHEDULED to DEPLOYING. - Deploying Filter -> Map (4/8) (attempt #0) with attempt id 7d03b476ed15f492d5f2b3b6fd6d70a5 to a6e88966-162b-44b4-b2fd-39461a1a440c @ 127.0.0.1 (dataPort=-1) with allocation id 764034c3267a443562b693e46aad20e5 - Filter -> Map (5/8) (7c2e16589f48980e9d1a98b2e7657812) switched from SCHEDULED to DEPLOYING. - Deploying Filter -> Map (5/8) (attempt #0) with attempt id 7c2e16589f48980e9d1a98b2e7657812 to a6e88966-162b-44b4-b2fd-39461a1a440c @ 127.0.0.1 (dataPort=-1) with allocation id 3b5cadd7193ba9bd4dc2cf7ccc9667b2 - Filter -> Map (6/8) (1167445b24e5d29a6b9ed39e64ae8b7b) switched from SCHEDULED to DEPLOYING. - Deploying Filter -> Map (6/8) (attempt #0) with attempt id 1167445b24e5d29a6b9ed39e64ae8b7b to a6e88966-162b-44b4-b2fd-39461a1a440c @ 127.0.0.1 (dataPort=-1) with allocation id 45b2be58c17c46712a1f99ffb71124c0 - Filter -> Map (7/8) (54a81f66851c0dd2941a3f803d219748) switched from SCHEDULED to DEPLOYING. - Deploying Filter -> Map (7/8) (attempt #0) with attempt id 54a81f66851c0dd2941a3f803d219748 to a6e88966-162b-44b4-b2fd-39461a1a440c @ 127.0.0.1 (dataPort=-1) with allocation id bc89ec13c8cfe5f30f33b9b92894ad6d - Filter -> Map (8/8) (4cbc4b54611bc044378ef998f3684352) switched from SCHEDULED to DEPLOYING. - Deploying Filter -> Map (8/8) (attempt #0) with attempt id 4cbc4b54611bc044378ef998f3684352 to a6e88966-162b-44b4-b2fd-39461a1a440c @ 127.0.0.1 (dataPort=-1) with allocation id 4a41e5491be9026da0456dd23f0709e4 - bucket_assigner (1/8) (1377c78b753cc343c4d864a472276ed9) switched from SCHEDULED to DEPLOYING. - Deploying bucket_assigner (1/8) (attempt #0) with attempt id 1377c78b753cc343c4d864a472276ed9 to a6e88966-162b-44b4-b2fd-39461a1a440c @ 127.0.0.1 (dataPort=-1) with allocation id 21a45995954d4f80f8e9559bd6c050c2 - bucket_assigner (2/8) (991aeded53c2b1faea239c5f09c0f7ba) switched from SCHEDULED to DEPLOYING. - Deploying bucket_assigner (2/8) (attempt #0) with attempt id 991aeded53c2b1faea239c5f09c0f7ba to a6e88966-162b-44b4-b2fd-39461a1a440c @ 127.0.0.1 (dataPort=-1) with allocation id 69e4facaa72255fa4011ad886be6e830 - bucket_assigner (3/8) (84bcfbf44e9fa5c3877d1d4a9c0e40e1) switched from SCHEDULED to DEPLOYING. - Deploying bucket_assigner (3/8) (attempt #0) with attempt id 84bcfbf44e9fa5c3877d1d4a9c0e40e1 to a6e88966-162b-44b4-b2fd-39461a1a440c @ 127.0.0.1 (dataPort=-1) with allocation id f738d448f48642d75b3bf69475df9c0a - bucket_assigner (4/8) (f2738a17abb5e3b94d2aa4afc3982bfb) switched from SCHEDULED to DEPLOYING. - Deploying bucket_assigner (4/8) (attempt #0) with attempt id f2738a17abb5e3b94d2aa4afc3982bfb to a6e88966-162b-44b4-b2fd-39461a1a440c @ 127.0.0.1 (dataPort=-1) with allocation id 764034c3267a443562b693e46aad20e5 - bucket_assigner (5/8) (ba6f95731e0e4f8bf6748ce3cae87a70) switched from SCHEDULED to DEPLOYING. - Deploying bucket_assigner (5/8) (attempt #0) with attempt id ba6f95731e0e4f8bf6748ce3cae87a70 to a6e88966-162b-44b4-b2fd-39461a1a440c @ 127.0.0.1 (dataPort=-1) with allocation id 3b5cadd7193ba9bd4dc2cf7ccc9667b2 - bucket_assigner (6/8) (d4aeffa74f82b79361f229cb61dbc990) switched from SCHEDULED to DEPLOYING. - Deploying bucket_assigner (6/8) (attempt #0) with attempt id d4aeffa74f82b79361f229cb61dbc990 to a6e88966-162b-44b4-b2fd-39461a1a440c @ 127.0.0.1 (dataPort=-1) with allocation id 45b2be58c17c46712a1f99ffb71124c0 - bucket_assigner (7/8) (cd6ba8fe96b84e26c7a0e9a0999a9e0c) switched from SCHEDULED to DEPLOYING. - Deploying bucket_assigner (7/8) (attempt #0) with attempt id cd6ba8fe96b84e26c7a0e9a0999a9e0c to a6e88966-162b-44b4-b2fd-39461a1a440c @ 127.0.0.1 (dataPort=-1) with allocation id bc89ec13c8cfe5f30f33b9b92894ad6d - bucket_assigner (8/8) (f55f88d3e637e42da3463df5ef5332a7) switched from SCHEDULED to DEPLOYING. - Deploying bucket_assigner (8/8) (attempt #0) with attempt id f55f88d3e637e42da3463df5ef5332a7 to a6e88966-162b-44b4-b2fd-39461a1a440c @ 127.0.0.1 (dataPort=-1) with allocation id 4a41e5491be9026da0456dd23f0709e4 - hoodie_stream_write (1/4) (888768308836b8f4831890fa2934fe2c) switched from SCHEDULED to DEPLOYING. - Deploying hoodie_stream_write (1/4) (attempt #0) with attempt id 888768308836b8f4831890fa2934fe2c to a6e88966-162b-44b4-b2fd-39461a1a440c @ 127.0.0.1 (dataPort=-1) with allocation id 21a45995954d4f80f8e9559bd6c050c2 - hoodie_stream_write (2/4) (d48422b9607bf34237abcaf9cbca24a2) switched from SCHEDULED to DEPLOYING. - Deploying hoodie_stream_write (2/4) (attempt #0) with attempt id d48422b9607bf34237abcaf9cbca24a2 to a6e88966-162b-44b4-b2fd-39461a1a440c @ 127.0.0.1 (dataPort=-1) with allocation id 69e4facaa72255fa4011ad886be6e830 - hoodie_stream_write (3/4) (ff5491c88ffc17a816e22c29b6da47be) switched from SCHEDULED to DEPLOYING. - Deploying hoodie_stream_write (3/4) (attempt #0) with attempt id ff5491c88ffc17a816e22c29b6da47be to a6e88966-162b-44b4-b2fd-39461a1a440c @ 127.0.0.1 (dataPort=-1) with allocation id f738d448f48642d75b3bf69475df9c0a - hoodie_stream_write (4/4) (5e2085d96585101e586a7ea47bc56a98) switched from SCHEDULED to DEPLOYING. - Deploying hoodie_stream_write (4/4) (attempt #0) with attempt id 5e2085d96585101e586a7ea47bc56a98 to a6e88966-162b-44b4-b2fd-39461a1a440c @ 127.0.0.1 (dataPort=-1) with allocation id 764034c3267a443562b693e46aad20e5 - Sink: clean_commits (1/1) (e46f7227496a98cb8360e4afa2fcdca1) switched from SCHEDULED to DEPLOYING. - Deploying Sink: clean_commits (1/1) (attempt #0) with attempt id e46f7227496a98cb8360e4afa2fcdca1 to a6e88966-162b-44b4-b2fd-39461a1a440c @ 127.0.0.1 (dataPort=-1) with allocation id 21a45995954d4f80f8e9559bd6c050c2 - Table option [hoodie.datasource.write.keygenerator.class] is reset to org.apache.hudi.keygen.NonpartitionedAvroKeyGenerator because this is a non-partitioned table - Loading HoodieTableMetaClient from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area - Loading table properties from file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/hoodie.properties - Finished Loading Table of type COPY_ON_WRITE(version=1, baseFileFormat=PARQUET) from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area - Received task Source: Values(tuples=[[{ 1, _UTF-16LE'1', _UTF-16LE'中国', _UTF-16LE'0', 1, _UTF-16LE'中国', _UTF-16LE'sap_area', _UTF-16LE'', _UTF-16LE'ENABLE', _UTF-16LE'zhangsan', 2021-09-18 16:48:00, _UTF-16LE'ayj', 2021-09-18 16:48:00, 0 }]]) (1/1)#0 (6a4bc3af8b2ff4a559b4ea525d82672f), deploy into slot with allocation id 21a45995954d4f80f8e9559bd6c050c2. - Source: Values(tuples=[[{ 1, _UTF-16LE'1', _UTF-16LE'中国', _UTF-16LE'0', 1, _UTF-16LE'中国', _UTF-16LE'sap_area', _UTF-16LE'', _UTF-16LE'ENABLE', _UTF-16LE'zhangsan', 2021-09-18 16:48:00, _UTF-16LE'ayj', 2021-09-18 16:48:00, 0 }]]) (1/1)#0 (6a4bc3af8b2ff4a559b4ea525d82672f) switched from CREATED to DEPLOYING. - Activate slot 21a45995954d4f80f8e9559bd6c050c2. - Loading JAR files for task Source: Values(tuples=[[{ 1, _UTF-16LE'1', _UTF-16LE'中国', _UTF-16LE'0', 1, _UTF-16LE'中国', _UTF-16LE'sap_area', _UTF-16LE'', _UTF-16LE'ENABLE', _UTF-16LE'zhangsan', 2021-09-18 16:48:00, _UTF-16LE'ayj', 2021-09-18 16:48:00, 0 }]]) (1/1)#0 (6a4bc3af8b2ff4a559b4ea525d82672f) [DEPLOYING]. - Registering task at network: Source: Values(tuples=[[{ 1, _UTF-16LE'1', _UTF-16LE'中国', _UTF-16LE'0', 1, _UTF-16LE'中国', _UTF-16LE'sap_area', _UTF-16LE'', _UTF-16LE'ENABLE', _UTF-16LE'zhangsan', 2021-09-18 16:48:00, _UTF-16LE'ayj', 2021-09-18 16:48:00, 0 }]]) (1/1)#0 (6a4bc3af8b2ff4a559b4ea525d82672f) [DEPLOYING]. - mapred.job.map.memory.mb is deprecated. Instead, use mapreduce.map.memory.mb - Received task Filter -> Map (1/8)#0 (921bd3faa6059f2011630dc6c7cf6205), deploy into slot with allocation id 21a45995954d4f80f8e9559bd6c050c2. - Filter -> Map (1/8)#0 (921bd3faa6059f2011630dc6c7cf6205) switched from CREATED to DEPLOYING. - Activate slot 69e4facaa72255fa4011ad886be6e830. - Loading JAR files for task Filter -> Map (1/8)#0 (921bd3faa6059f2011630dc6c7cf6205) [DEPLOYING]. - Registering task at network: Filter -> Map (1/8)#0 (921bd3faa6059f2011630dc6c7cf6205) [DEPLOYING]. - Received task Filter -> Map (2/8)#0 (2f7ff7feae62ead6c95de8adcbae446f), deploy into slot with allocation id 69e4facaa72255fa4011ad886be6e830. - Activate slot f738d448f48642d75b3bf69475df9c0a. - Filter -> Map (2/8)#0 (2f7ff7feae62ead6c95de8adcbae446f) switched from CREATED to DEPLOYING. - Loading JAR files for task Filter -> Map (2/8)#0 (2f7ff7feae62ead6c95de8adcbae446f) [DEPLOYING]. - Registering task at network: Filter -> Map (2/8)#0 (2f7ff7feae62ead6c95de8adcbae446f) [DEPLOYING]. - Received task Filter -> Map (3/8)#0 (f55cea56f6c92ae6431d74d60038df8d), deploy into slot with allocation id f738d448f48642d75b3bf69475df9c0a. - Filter -> Map (3/8)#0 (f55cea56f6c92ae6431d74d60038df8d) switched from CREATED to DEPLOYING. - Activate slot 764034c3267a443562b693e46aad20e5. - Loading JAR files for task Filter -> Map (3/8)#0 (f55cea56f6c92ae6431d74d60038df8d) [DEPLOYING]. - Registering task at network: Filter -> Map (3/8)#0 (f55cea56f6c92ae6431d74d60038df8d) [DEPLOYING]. - Received task Filter -> Map (4/8)#0 (7d03b476ed15f492d5f2b3b6fd6d70a5), deploy into slot with allocation id 764034c3267a443562b693e46aad20e5. - Filter -> Map (4/8)#0 (7d03b476ed15f492d5f2b3b6fd6d70a5) switched from CREATED to DEPLOYING. - Loading JAR files for task Filter -> Map (4/8)#0 (7d03b476ed15f492d5f2b3b6fd6d70a5) [DEPLOYING]. - Activate slot 3b5cadd7193ba9bd4dc2cf7ccc9667b2. - Registering task at network: Filter -> Map (4/8)#0 (7d03b476ed15f492d5f2b3b6fd6d70a5) [DEPLOYING]. - Received task Filter -> Map (5/8)#0 (7c2e16589f48980e9d1a98b2e7657812), deploy into slot with allocation id 3b5cadd7193ba9bd4dc2cf7ccc9667b2. - Activate slot 45b2be58c17c46712a1f99ffb71124c0. - Filter -> Map (5/8)#0 (7c2e16589f48980e9d1a98b2e7657812) switched from CREATED to DEPLOYING. - Loading JAR files for task Filter -> Map (5/8)#0 (7c2e16589f48980e9d1a98b2e7657812) [DEPLOYING]. - Registering task at network: Filter -> Map (5/8)#0 (7c2e16589f48980e9d1a98b2e7657812) [DEPLOYING]. - Received task Filter -> Map (6/8)#0 (1167445b24e5d29a6b9ed39e64ae8b7b), deploy into slot with allocation id 45b2be58c17c46712a1f99ffb71124c0. - Activate slot bc89ec13c8cfe5f30f33b9b92894ad6d. - Filter -> Map (6/8)#0 (1167445b24e5d29a6b9ed39e64ae8b7b) switched from CREATED to DEPLOYING. - Loading JAR files for task Filter -> Map (6/8)#0 (1167445b24e5d29a6b9ed39e64ae8b7b) [DEPLOYING]. - Registering task at network: Filter -> Map (6/8)#0 (1167445b24e5d29a6b9ed39e64ae8b7b) [DEPLOYING]. - Received task Filter -> Map (7/8)#0 (54a81f66851c0dd2941a3f803d219748), deploy into slot with allocation id bc89ec13c8cfe5f30f33b9b92894ad6d. - Activate slot 4a41e5491be9026da0456dd23f0709e4. - Filter -> Map (7/8)#0 (54a81f66851c0dd2941a3f803d219748) switched from CREATED to DEPLOYING. - Loading JAR files for task Filter -> Map (7/8)#0 (54a81f66851c0dd2941a3f803d219748) [DEPLOYING]. - Registering task at network: Filter -> Map (7/8)#0 (54a81f66851c0dd2941a3f803d219748) [DEPLOYING]. - Received task Filter -> Map (8/8)#0 (4cbc4b54611bc044378ef998f3684352), deploy into slot with allocation id 4a41e5491be9026da0456dd23f0709e4. - Activate slot 21a45995954d4f80f8e9559bd6c050c2. - Using job/cluster config to configure application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: UNDEFINED, maxStateSize: 5242880) - Received task bucket_assigner (1/8)#0 (1377c78b753cc343c4d864a472276ed9), deploy into slot with allocation id 21a45995954d4f80f8e9559bd6c050c2. - Activate slot 69e4facaa72255fa4011ad886be6e830. - bucket_assigner (1/8)#0 (1377c78b753cc343c4d864a472276ed9) switched from CREATED to DEPLOYING. - Using application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880) - Loading JAR files for task bucket_assigner (1/8)#0 (1377c78b753cc343c4d864a472276ed9) [DEPLOYING]. - Filter -> Map (8/8)#0 (4cbc4b54611bc044378ef998f3684352) switched from CREATED to DEPLOYING. - Loading JAR files for task Filter -> Map (8/8)#0 (4cbc4b54611bc044378ef998f3684352) [DEPLOYING]. - Using job/cluster config to configure application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: UNDEFINED, maxStateSize: 5242880) - Using application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880) - Using job/cluster config to configure application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: UNDEFINED, maxStateSize: 5242880) - Using application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880) - Registering task at network: bucket_assigner (1/8)#0 (1377c78b753cc343c4d864a472276ed9) [DEPLOYING]. - Registering task at network: Filter -> Map (8/8)#0 (4cbc4b54611bc044378ef998f3684352) [DEPLOYING]. - Using job/cluster config to configure application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: UNDEFINED, maxStateSize: 5242880) - Using job/cluster config to configure application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: UNDEFINED, maxStateSize: 5242880) - Using application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880) - Using job/cluster config to configure application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: UNDEFINED, maxStateSize: 5242880) - Using application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880) - Using job/cluster config to configure application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: UNDEFINED, maxStateSize: 5242880) - Using application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880) - Using job/cluster config to configure application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: UNDEFINED, maxStateSize: 5242880) - Using application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880) - Received task bucket_assigner (2/8)#0 (991aeded53c2b1faea239c5f09c0f7ba), deploy into slot with allocation id 69e4facaa72255fa4011ad886be6e830. - Activate slot f738d448f48642d75b3bf69475df9c0a. - Using application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880) - Received task bucket_assigner (3/8)#0 (84bcfbf44e9fa5c3877d1d4a9c0e40e1), deploy into slot with allocation id f738d448f48642d75b3bf69475df9c0a. - Using job/cluster config to configure application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: UNDEFINED, maxStateSize: 5242880) - Using application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880) - Activate slot 764034c3267a443562b693e46aad20e5. - Using job/cluster config to configure application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: UNDEFINED, maxStateSize: 5242880) - Using application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880) - bucket_assigner (2/8)#0 (991aeded53c2b1faea239c5f09c0f7ba) switched from CREATED to DEPLOYING. - Received task bucket_assigner (4/8)#0 (f2738a17abb5e3b94d2aa4afc3982bfb), deploy into slot with allocation id 764034c3267a443562b693e46aad20e5. - Loading JAR files for task bucket_assigner (2/8)#0 (991aeded53c2b1faea239c5f09c0f7ba) [DEPLOYING]. - bucket_assigner (3/8)#0 (84bcfbf44e9fa5c3877d1d4a9c0e40e1) switched from CREATED to DEPLOYING. - bucket_assigner (4/8)#0 (f2738a17abb5e3b94d2aa4afc3982bfb) switched from CREATED to DEPLOYING. - Activate slot 3b5cadd7193ba9bd4dc2cf7ccc9667b2. - Loading JAR files for task bucket_assigner (4/8)#0 (f2738a17abb5e3b94d2aa4afc3982bfb) [DEPLOYING]. - Loading JAR files for task bucket_assigner (3/8)#0 (84bcfbf44e9fa5c3877d1d4a9c0e40e1) [DEPLOYING]. - Registering task at network: bucket_assigner (2/8)#0 (991aeded53c2b1faea239c5f09c0f7ba) [DEPLOYING]. - Registering task at network: bucket_assigner (3/8)#0 (84bcfbf44e9fa5c3877d1d4a9c0e40e1) [DEPLOYING]. - Registering task at network: bucket_assigner (4/8)#0 (f2738a17abb5e3b94d2aa4afc3982bfb) [DEPLOYING]. - Received task bucket_assigner (5/8)#0 (ba6f95731e0e4f8bf6748ce3cae87a70), deploy into slot with allocation id 3b5cadd7193ba9bd4dc2cf7ccc9667b2. - Using job/cluster config to configure application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: UNDEFINED, maxStateSize: 5242880) - Using application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880) - Using job/cluster config to configure application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: UNDEFINED, maxStateSize: 5242880) - Using application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880) - Using job/cluster config to configure application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: UNDEFINED, maxStateSize: 5242880) - Using application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880) - Activate slot 45b2be58c17c46712a1f99ffb71124c0. - bucket_assigner (5/8)#0 (ba6f95731e0e4f8bf6748ce3cae87a70) switched from CREATED to DEPLOYING. - Loading JAR files for task bucket_assigner (5/8)#0 (ba6f95731e0e4f8bf6748ce3cae87a70) [DEPLOYING]. - Registering task at network: bucket_assigner (5/8)#0 (ba6f95731e0e4f8bf6748ce3cae87a70) [DEPLOYING]. - Filter -> Map (1/8)#0 (921bd3faa6059f2011630dc6c7cf6205) switched from DEPLOYING to RUNNING. - Received task bucket_assigner (6/8)#0 (d4aeffa74f82b79361f229cb61dbc990), deploy into slot with allocation id 45b2be58c17c46712a1f99ffb71124c0. - Filter -> Map (2/8)#0 (2f7ff7feae62ead6c95de8adcbae446f) switched from DEPLOYING to RUNNING. - Filter -> Map (8/8)#0 (4cbc4b54611bc044378ef998f3684352) switched from DEPLOYING to RUNNING. - bucket_assigner (6/8)#0 (d4aeffa74f82b79361f229cb61dbc990) switched from CREATED to DEPLOYING. - Using job/cluster config to configure application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: UNDEFINED, maxStateSize: 5242880) - Using application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880) - bucket_assigner (5/8)#0 (ba6f95731e0e4f8bf6748ce3cae87a70) switched from DEPLOYING to RUNNING. - Activate slot bc89ec13c8cfe5f30f33b9b92894ad6d. - Filter -> Map (4/8)#0 (7d03b476ed15f492d5f2b3b6fd6d70a5) switched from DEPLOYING to RUNNING. - bucket_assigner (4/8)#0 (f2738a17abb5e3b94d2aa4afc3982bfb) switched from DEPLOYING to RUNNING. - Filter -> Map (3/8)#0 (f55cea56f6c92ae6431d74d60038df8d) switched from DEPLOYING to RUNNING. - Source: Values(tuples=[[{ 1, _UTF-16LE'1', _UTF-16LE'中国', _UTF-16LE'0', 1, _UTF-16LE'中国', _UTF-16LE'sap_area', _UTF-16LE'', _UTF-16LE'ENABLE', _UTF-16LE'zhangsan', 2021-09-18 16:48:00, _UTF-16LE'ayj', 2021-09-18 16:48:00, 0 }]]) (1/1)#0 (6a4bc3af8b2ff4a559b4ea525d82672f) switched from DEPLOYING to RUNNING. - Loading JAR files for task bucket_assigner (6/8)#0 (d4aeffa74f82b79361f229cb61dbc990) [DEPLOYING]. - Received task bucket_assigner (7/8)#0 (cd6ba8fe96b84e26c7a0e9a0999a9e0c), deploy into slot with allocation id bc89ec13c8cfe5f30f33b9b92894ad6d. - bucket_assigner (7/8)#0 (cd6ba8fe96b84e26c7a0e9a0999a9e0c) switched from CREATED to DEPLOYING. - Filter -> Map (6/8)#0 (1167445b24e5d29a6b9ed39e64ae8b7b) switched from DEPLOYING to RUNNING. - Filter -> Map (5/8)#0 (7c2e16589f48980e9d1a98b2e7657812) switched from DEPLOYING to RUNNING. - Filter -> Map (7/8)#0 (54a81f66851c0dd2941a3f803d219748) switched from DEPLOYING to RUNNING. - bucket_assigner (3/8)#0 (84bcfbf44e9fa5c3877d1d4a9c0e40e1) switched from DEPLOYING to RUNNING. - bucket_assigner (1/8)#0 (1377c78b753cc343c4d864a472276ed9) switched from DEPLOYING to RUNNING. - Filter -> Map (1/8) (921bd3faa6059f2011630dc6c7cf6205) switched from DEPLOYING to RUNNING. - bucket_assigner (2/8)#0 (991aeded53c2b1faea239c5f09c0f7ba) switched from DEPLOYING to RUNNING. - Filter -> Map (2/8) (2f7ff7feae62ead6c95de8adcbae446f) switched from DEPLOYING to RUNNING. - Loading JAR files for task bucket_assigner (7/8)#0 (cd6ba8fe96b84e26c7a0e9a0999a9e0c) [DEPLOYING]. - Registering task at network: bucket_assigner (6/8)#0 (d4aeffa74f82b79361f229cb61dbc990) [DEPLOYING]. - Registering task at network: bucket_assigner (7/8)#0 (cd6ba8fe96b84e26c7a0e9a0999a9e0c) [DEPLOYING]. - Activate slot 4a41e5491be9026da0456dd23f0709e4. - Filter -> Map (8/8) (4cbc4b54611bc044378ef998f3684352) switched from DEPLOYING to RUNNING. - bucket_assigner (5/8) (ba6f95731e0e4f8bf6748ce3cae87a70) switched from DEPLOYING to RUNNING. - bucket_assigner (4/8) (f2738a17abb5e3b94d2aa4afc3982bfb) switched from DEPLOYING to RUNNING. - Filter -> Map (4/8) (7d03b476ed15f492d5f2b3b6fd6d70a5) switched from DEPLOYING to RUNNING. - Filter -> Map (3/8) (f55cea56f6c92ae6431d74d60038df8d) switched from DEPLOYING to RUNNING. - Source: Values(tuples=[[{ 1, _UTF-16LE'1', _UTF-16LE'中国', _UTF-16LE'0', 1, _UTF-16LE'中国', _UTF-16LE'sap_area', _UTF-16LE'', _UTF-16LE'ENABLE', _UTF-16LE'zhangsan', 2021-09-18 16:48:00, _UTF-16LE'ayj', 2021-09-18 16:48:00, 0 }]]) (1/1) (6a4bc3af8b2ff4a559b4ea525d82672f) switched from DEPLOYING to RUNNING. - Filter -> Map (6/8) (1167445b24e5d29a6b9ed39e64ae8b7b) switched from DEPLOYING to RUNNING. - Filter -> Map (5/8) (7c2e16589f48980e9d1a98b2e7657812) switched from DEPLOYING to RUNNING. - Using job/cluster config to configure application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: UNDEFINED, maxStateSize: 5242880) - Using application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880) - bucket_assigner (6/8)#0 (d4aeffa74f82b79361f229cb61dbc990) switched from DEPLOYING to RUNNING. - Using job/cluster config to configure application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: UNDEFINED, maxStateSize: 5242880) - Using application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880) - bucket_assigner (7/8)#0 (cd6ba8fe96b84e26c7a0e9a0999a9e0c) switched from DEPLOYING to RUNNING. - Filter -> Map (7/8) (54a81f66851c0dd2941a3f803d219748) switched from DEPLOYING to RUNNING. - bucket_assigner (3/8) (84bcfbf44e9fa5c3877d1d4a9c0e40e1) switched from DEPLOYING to RUNNING. - bucket_assigner (1/8) (1377c78b753cc343c4d864a472276ed9) switched from DEPLOYING to RUNNING. - bucket_assigner (2/8) (991aeded53c2b1faea239c5f09c0f7ba) switched from DEPLOYING to RUNNING. - Received task bucket_assigner (8/8)#0 (f55f88d3e637e42da3463df5ef5332a7), deploy into slot with allocation id 4a41e5491be9026da0456dd23f0709e4. - bucket_assigner (6/8) (d4aeffa74f82b79361f229cb61dbc990) switched from DEPLOYING to RUNNING. - Activate slot 21a45995954d4f80f8e9559bd6c050c2. - bucket_assigner (8/8)#0 (f55f88d3e637e42da3463df5ef5332a7) switched from CREATED to DEPLOYING. - Loading JAR files for task bucket_assigner (8/8)#0 (f55f88d3e637e42da3463df5ef5332a7) [DEPLOYING]. - Registering task at network: bucket_assigner (8/8)#0 (f55f88d3e637e42da3463df5ef5332a7) [DEPLOYING]. - bucket_assigner (7/8) (cd6ba8fe96b84e26c7a0e9a0999a9e0c) switched from DEPLOYING to RUNNING. - Received task hoodie_stream_write (1/4)#0 (888768308836b8f4831890fa2934fe2c), deploy into slot with allocation id 21a45995954d4f80f8e9559bd6c050c2. - Activate slot 69e4facaa72255fa4011ad886be6e830. - Received task hoodie_stream_write (2/4)#0 (d48422b9607bf34237abcaf9cbca24a2), deploy into slot with allocation id 69e4facaa72255fa4011ad886be6e830. - hoodie_stream_write (1/4)#0 (888768308836b8f4831890fa2934fe2c) switched from CREATED to DEPLOYING. - Loading JAR files for task hoodie_stream_write (1/4)#0 (888768308836b8f4831890fa2934fe2c) [DEPLOYING]. - hoodie_stream_write (2/4)#0 (d48422b9607bf34237abcaf9cbca24a2) switched from CREATED to DEPLOYING. - Activate slot f738d448f48642d75b3bf69475df9c0a. - Received task hoodie_stream_write (3/4)#0 (ff5491c88ffc17a816e22c29b6da47be), deploy into slot with allocation id f738d448f48642d75b3bf69475df9c0a. - hoodie_stream_write (3/4)#0 (ff5491c88ffc17a816e22c29b6da47be) switched from CREATED to DEPLOYING. - Loading JAR files for task hoodie_stream_write (3/4)#0 (ff5491c88ffc17a816e22c29b6da47be) [DEPLOYING]. - Loading JAR files for task hoodie_stream_write (2/4)#0 (d48422b9607bf34237abcaf9cbca24a2) [DEPLOYING]. - Registering task at network: hoodie_stream_write (3/4)#0 (ff5491c88ffc17a816e22c29b6da47be) [DEPLOYING]. - Registering task at network: hoodie_stream_write (2/4)#0 (d48422b9607bf34237abcaf9cbca24a2) [DEPLOYING]. - Activate slot 764034c3267a443562b693e46aad20e5. - Using job/cluster config to configure application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: UNDEFINED, maxStateSize: 5242880) - Using application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880) - bucket_assigner (8/8)#0 (f55f88d3e637e42da3463df5ef5332a7) switched from DEPLOYING to RUNNING. - Using job/cluster config to configure application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: UNDEFINED, maxStateSize: 5242880) - Using application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880) - hoodie_stream_write (2/4)#0 (d48422b9607bf34237abcaf9cbca24a2) switched from DEPLOYING to RUNNING. - Registering task at network: hoodie_stream_write (1/4)#0 (888768308836b8f4831890fa2934fe2c) [DEPLOYING]. - bucket_assigner (8/8) (f55f88d3e637e42da3463df5ef5332a7) switched from DEPLOYING to RUNNING. - Using job/cluster config to configure application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: UNDEFINED, maxStateSize: 5242880) - Using application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880) - hoodie_stream_write (2/4) (d48422b9607bf34237abcaf9cbca24a2) switched from DEPLOYING to RUNNING. - hoodie_stream_write (3/4)#0 (ff5491c88ffc17a816e22c29b6da47be) switched from DEPLOYING to RUNNING. - Using job/cluster config to configure application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: UNDEFINED, maxStateSize: 5242880) - Using application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880) - hoodie_stream_write (1/4)#0 (888768308836b8f4831890fa2934fe2c) switched from DEPLOYING to RUNNING. - Received task hoodie_stream_write (4/4)#0 (5e2085d96585101e586a7ea47bc56a98), deploy into slot with allocation id 764034c3267a443562b693e46aad20e5.

10:34:05,441 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - hoodie_stream_write (3/4) (ff5491c88ffc17a816e22c29b6da47be) switched from DEPLOYING to RUNNING. 10:34:05,441 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - hoodie_stream_write (1/4) (888768308836b8f4831890fa2934fe2c) switched from DEPLOYING to RUNNING. 10:34:05,443 INFO org.apache.flink.runtime.taskmanager.Task - hoodie_stream_write (4/4)#0 (5e2085d96585101e586a7ea47bc56a98) switched from CREATED to DEPLOYING. 10:34:05,444 INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task hoodie_stream_write (4/4)#0 (5e2085d96585101e586a7ea47bc56a98) [DEPLOYING]. 10:34:05,444 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl - Activate slot bc89ec13c8cfe5f30f33b9b92894ad6d. 10:34:05,444 WARN org.apache.flink.metrics.MetricGroup - The operator name Source: Values(tuples=[[{ 1, _UTF-16LE'1', _UTF-16LE'中国', _UTF-16LE'0', 1, _UTF-16LE'中国', _UTF-16LE'sap_area', _UTF-16LE'', _UTF-16LE'ENABLE', _UTF-16LE'zhangsan', 2021-09-18 16:48:00, _UTF-16LE'ayj', 2021-09-18 16:48:00, 0 }]]) exceeded the 80 characters length limit and was truncated. 10:34:05,444 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl - Activate slot 764034c3267a443562b693e46aad20e5. 10:34:05,446 INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: hoodie_stream_write (4/4)#0 (5e2085d96585101e586a7ea47bc56a98) [DEPLOYING]. 10:34:05,446 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl - Activate slot 45b2be58c17c46712a1f99ffb71124c0. 10:34:05,447 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl - Activate slot 3b5cadd7193ba9bd4dc2cf7ccc9667b2. 10:34:05,447 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl - Activate slot 4a41e5491be9026da0456dd23f0709e4. 10:34:05,447 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl - Activate slot 69e4facaa72255fa4011ad886be6e830. 10:34:05,447 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl - Activate slot f738d448f48642d75b3bf69475df9c0a. 10:34:05,447 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl - Activate slot 21a45995954d4f80f8e9559bd6c050c2. 10:34:05,448 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl - Activate slot 21a45995954d4f80f8e9559bd6c050c2. 10:34:05,449 INFO org.apache.flink.streaming.runtime.tasks.StreamTask - Using job/cluster config to configure application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: UNDEFINED, maxStateSize: 5242880) 10:34:05,449 INFO org.apache.flink.streaming.runtime.tasks.StreamTask - Using application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880) 10:34:05,449 INFO org.apache.flink.runtime.taskmanager.Task - hoodie_stream_write (4/4)#0 (5e2085d96585101e586a7ea47bc56a98) switched from DEPLOYING to RUNNING. 10:34:05,450 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - hoodie_stream_write (4/4) (5e2085d96585101e586a7ea47bc56a98) switched from DEPLOYING to RUNNING. 10:34:05,450 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task Sink: clean_commits (1/1)#0 (e46f7227496a98cb8360e4afa2fcdca1), deploy into slot with allocation id 21a45995954d4f80f8e9559bd6c050c2. 10:34:05,451 INFO org.apache.flink.runtime.taskmanager.Task - Sink: clean_commits (1/1)#0 (e46f7227496a98cb8360e4afa2fcdca1) switched from CREATED to DEPLOYING. 10:34:05,451 INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task Sink: clean_commits (1/1)#0 (e46f7227496a98cb8360e4afa2fcdca1) [DEPLOYING]. 10:34:05,452 INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: Sink: clean_commits (1/1)#0 (e46f7227496a98cb8360e4afa2fcdca1) [DEPLOYING]. 10:34:05,454 INFO org.apache.flink.streaming.runtime.tasks.StreamTask - Using job/cluster config to configure application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: UNDEFINED, maxStateSize: 5242880) 10:34:05,454 INFO org.apache.flink.streaming.runtime.tasks.StreamTask - Using application-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880) 10:34:05,454 INFO org.apache.flink.runtime.taskmanager.Task - Sink: clean_commits (1/1)#0 (e46f7227496a98cb8360e4afa2fcdca1) switched from DEPLOYING to RUNNING. 10:34:05,458 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: clean_commits (1/1) (e46f7227496a98cb8360e4afa2fcdca1) switched from DEPLOYING to RUNNING. 10:34:05,517 INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackendBuilder - Finished to build heap keyed state-backend. 10:34:05,517 INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackendBuilder - Finished to build heap keyed state-backend. 10:34:05,518 INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackendBuilder - Finished to build heap keyed state-backend. 10:34:05,518 INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackendBuilder - Finished to build heap keyed state-backend. 10:34:05,518 INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackendBuilder - Finished to build heap keyed state-backend. 10:34:05,517 INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackendBuilder - Finished to build heap keyed state-backend. 10:34:05,517 INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackendBuilder - Finished to build heap keyed state-backend. 10:34:05,517 INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackendBuilder - Finished to build heap keyed state-backend. 10:34:05,517 INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackendBuilder - Finished to build heap keyed state-backend. 10:34:05,517 INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackendBuilder - Finished to build heap keyed state-backend. 10:34:05,517 INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackendBuilder - Finished to build heap keyed state-backend. 10:34:05,517 INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackendBuilder - Finished to build heap keyed state-backend. 10:34:05,528 WARN org.apache.flink.runtime.taskmanager.TaskManagerLocation - No hostname could be resolved for the IP address 127.0.0.1, using IP address as host name. Local input split assignment (such as for HDFS files) may be impacted. 10:34:05,534 INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory. 10:34:05,541 INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory. 10:34:05,548 INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory. 10:34:05,547 INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory. 10:34:05,550 INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory. 10:34:05,550 INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory. 10:34:05,547 INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory. 10:34:05,547 INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory. 10:34:05,552 INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory. 10:34:05,552 INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory. 10:34:05,552 INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory. 10:34:05,552 INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory. 10:34:05,613 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Loading HoodieTableMetaClient from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:05,614 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Loading HoodieTableMetaClient from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:05,614 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Loading HoodieTableMetaClient from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:05,614 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Loading HoodieTableMetaClient from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:05,634 INFO org.apache.hudi.common.table.HoodieTableConfig - Loading table properties from file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/hoodie.properties 10:34:05,636 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Finished Loading Table of type COPY_ON_WRITE(version=1, baseFileFormat=PARQUET) from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:05,637 INFO org.apache.hudi.common.table.HoodieTableConfig - Loading table properties from file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/hoodie.properties 10:34:05,638 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Finished Loading Table of type COPY_ON_WRITE(version=1, baseFileFormat=PARQUET) from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:05,640 INFO org.apache.hudi.common.table.HoodieTableConfig - Loading table properties from file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/hoodie.properties 10:34:05,641 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Finished Loading Table of type COPY_ON_WRITE(version=1, baseFileFormat=PARQUET) from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:05,645 INFO org.apache.hudi.common.table.HoodieTableConfig - Loading table properties from file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/hoodie.properties 10:34:05,647 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Finished Loading Table of type COPY_ON_WRITE(version=1, baseFileFormat=PARQUET) from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:05,662 INFO org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Loaded instants upto : Optional.empty 10:34:05,662 INFO org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Loaded instants upto : Optional.empty 10:34:05,663 INFO org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Loaded instants upto : Optional.empty 10:34:05,662 INFO org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Loaded instants upto : Optional.empty 10:34:05,665 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Loading HoodieTableMetaClient from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:05,668 INFO org.apache.hudi.sink.StreamWriteFunction - Send bootstrap write metadata event to coordinator, task[1]. 10:34:05,668 INFO org.apache.hudi.sink.StreamWriteFunction - Send bootstrap write metadata event to coordinator, task[3]. 10:34:05,668 INFO org.apache.hudi.sink.StreamWriteFunction - Send bootstrap write metadata event to coordinator, task[2]. 10:34:05,674 INFO org.apache.hudi.sink.StreamWriteFunction - Send bootstrap write metadata event to coordinator, task[0]. 10:34:05,676 INFO org.apache.hudi.sink.StreamWriteOperatorCoordinator - Executor executes action [handle write metadata event for instant ] success! 10:34:05,676 INFO org.apache.hudi.sink.StreamWriteOperatorCoordinator - Executor executes action [handle write metadata event for instant ] success! 10:34:05,677 INFO org.apache.hudi.sink.StreamWriteOperatorCoordinator - Executor executes action [handle write metadata event for instant ] success! 10:34:05,678 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Loading HoodieTableMetaClient from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:05,678 INFO org.apache.hudi.common.table.HoodieTableConfig - Loading table properties from file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/hoodie.properties 10:34:05,679 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Finished Loading Table of type COPY_ON_WRITE(version=1, baseFileFormat=PARQUET) from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:05,679 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Loading Active commit timeline for file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:05,681 INFO org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Loaded instants upto : Optional.empty 10:34:05,690 INFO org.apache.hudi.common.table.view.FileSystemViewManager - Creating View Manager with storage type :MEMORY 10:34:05,690 INFO org.apache.hudi.common.table.view.FileSystemViewManager - Creating in-memory based Table View 10:34:05,691 INFO org.apache.hudi.common.table.HoodieTableConfig - Loading table properties from file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/hoodie.properties 10:34:05,694 INFO org.apache.hudi.sink.partitioner.profile.WriteProfile - Refresh average bytes per record => 1024 10:34:05,694 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Finished Loading Table of type COPY_ON_WRITE(version=1, baseFileFormat=PARQUET) from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:05,696 INFO org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Loaded instants upto : Optional.empty 10:34:05,699 INFO org.apache.hudi.sink.StreamWriteOperatorCoordinator - Executor executes action [handle write metadata event for instant ] success! 10:34:05,704 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Loading HoodieTableMetaClient from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:05,707 INFO org.apache.hudi.common.table.HoodieTableConfig - Loading table properties from file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/hoodie.properties 10:34:05,708 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Finished Loading Table of type COPY_ON_WRITE(version=1, baseFileFormat=PARQUET) from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:05,708 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Loading Active commit timeline for file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:05,709 INFO org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Loaded instants upto : Optional.empty 10:34:05,717 INFO org.apache.flink.runtime.taskmanager.Task - Source: Values(tuples=[[{ 1, _UTF-16LE'1', _UTF-16LE'中国', _UTF-16LE'0', 1, _UTF-16LE'中国', _UTF-16LE'sap_area', _UTF-16LE'', _UTF-16LE'ENABLE', _UTF-16LE'zhangsan', 2021-09-18 16:48:00, _UTF-16LE'ayj', 2021-09-18 16:48:00, 0 }]]) (1/1)#0 (6a4bc3af8b2ff4a559b4ea525d82672f) switched from RUNNING to FINISHED. 10:34:05,717 INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Values(tuples=[[{ 1, _UTF-16LE'1', _UTF-16LE'中国', _UTF-16LE'0', 1, _UTF-16LE'中国', _UTF-16LE'sap_area', _UTF-16LE'', _UTF-16LE'ENABLE', _UTF-16LE'zhangsan', 2021-09-18 16:48:00, _UTF-16LE'ayj', 2021-09-18 16:48:00, 0 }]]) (1/1)#0 (6a4bc3af8b2ff4a559b4ea525d82672f). 10:34:05,720 INFO org.apache.flink.runtime.taskmanager.Task - Filter -> Map (3/8)#0 (f55cea56f6c92ae6431d74d60038df8d) switched from RUNNING to FINISHED. 10:34:05,720 INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Filter -> Map (3/8)#0 (f55cea56f6c92ae6431d74d60038df8d). 10:34:05,717 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Loading HoodieTableMetaClient from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:05,723 INFO org.apache.flink.runtime.taskmanager.Task - Filter -> Map (4/8)#0 (7d03b476ed15f492d5f2b3b6fd6d70a5) switched from RUNNING to FINISHED. 10:34:05,730 INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Filter -> Map (4/8)#0 (7d03b476ed15f492d5f2b3b6fd6d70a5). 10:34:05,722 INFO org.apache.flink.runtime.taskmanager.Task - Filter -> Map (8/8)#0 (4cbc4b54611bc044378ef998f3684352) switched from RUNNING to FINISHED. 10:34:05,722 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Values(tuples=[[{ 1, _UTF-16LE'1', _UTF-16LE'中国', _UTF-16LE'0', 1, _UTF-16LE'中国', _UTF-16LE'sap_area', _UTF-16LE'', _UTF-16LE'ENABLE', _UTF-16LE'zhangsan', 2021-09-18 16:48:00, _UTF-16LE'ayj', 2021-09-18 16:48:00, 0 }]]) (1/1)#0 6a4bc3af8b2ff4a559b4ea525d82672f. 10:34:05,734 INFO org.apache.flink.runtime.taskmanager.Task - Filter -> Map (5/8)#0 (7c2e16589f48980e9d1a98b2e7657812) switched from RUNNING to FINISHED. 10:34:05,734 INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Filter -> Map (5/8)#0 (7c2e16589f48980e9d1a98b2e7657812). 10:34:05,734 INFO org.apache.flink.runtime.taskmanager.Task - Filter -> Map (7/8)#0 (54a81f66851c0dd2941a3f803d219748) switched from RUNNING to FINISHED. 10:34:05,734 INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Filter -> Map (7/8)#0 (54a81f66851c0dd2941a3f803d219748). 10:34:05,735 INFO org.apache.flink.runtime.taskmanager.Task - Filter -> Map (2/8)#0 (2f7ff7feae62ead6c95de8adcbae446f) switched from RUNNING to FINISHED. 10:34:05,735 INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Filter -> Map (2/8)#0 (2f7ff7feae62ead6c95de8adcbae446f). 10:34:05,735 INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Filter -> Map (8/8)#0 (4cbc4b54611bc044378ef998f3684352). 10:34:05,737 INFO org.apache.hudi.common.table.HoodieTableConfig - Loading table properties from file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/hoodie.properties 10:34:05,738 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Finished Loading Table of type COPY_ON_WRITE(version=1, baseFileFormat=PARQUET) from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:05,738 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Loading Active commit timeline for file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:05,739 INFO org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Loaded instants upto : Optional.empty 10:34:05,741 INFO org.apache.hudi.common.table.view.FileSystemViewManager - Creating View Manager with storage type :REMOTE_FIRST 10:34:05,741 INFO org.apache.hudi.common.table.view.FileSystemViewManager - Creating remote first table view 10:34:05,742 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Filter -> Map (3/8)#0 f55cea56f6c92ae6431d74d60038df8d. 10:34:05,743 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Filter -> Map (4/8)#0 7d03b476ed15f492d5f2b3b6fd6d70a5. 10:34:05,743 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Filter -> Map (5/8)#0 7c2e16589f48980e9d1a98b2e7657812. 10:34:05,743 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Filter -> Map (7/8)#0 54a81f66851c0dd2941a3f803d219748. 10:34:05,743 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Filter -> Map (2/8)#0 2f7ff7feae62ead6c95de8adcbae446f. 10:34:05,743 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Filter -> Map (8/8)#0 4cbc4b54611bc044378ef998f3684352. 10:34:05,744 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Loading HoodieTableMetaClient from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:05,744 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Values(tuples=[[{ 1, _UTF-16LE'1', _UTF-16LE'中国', _UTF-16LE'0', 1, _UTF-16LE'中国', _UTF-16LE'sap_area', _UTF-16LE'', _UTF-16LE'ENABLE', _UTF-16LE'zhangsan', 2021-09-18 16:48:00, _UTF-16LE'ayj', 2021-09-18 16:48:00, 0 }]]) (1/1) (6a4bc3af8b2ff4a559b4ea525d82672f) switched from RUNNING to FINISHED. 10:34:05,746 INFO org.apache.hudi.common.table.HoodieTableConfig - Loading table properties from file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/hoodie.properties 10:34:05,747 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Finished Loading Table of type COPY_ON_WRITE(version=1, baseFileFormat=PARQUET) from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:05,747 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Loading Active commit timeline for file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:05,747 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter -> Map (3/8) (f55cea56f6c92ae6431d74d60038df8d) switched from RUNNING to FINISHED. 10:34:05,748 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter -> Map (4/8) (7d03b476ed15f492d5f2b3b6fd6d70a5) switched from RUNNING to FINISHED. 10:34:05,748 INFO org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Loaded instants upto : Optional.empty 10:34:05,748 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter -> Map (5/8) (7c2e16589f48980e9d1a98b2e7657812) switched from RUNNING to FINISHED. 10:34:05,749 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter -> Map (7/8) (54a81f66851c0dd2941a3f803d219748) switched from RUNNING to FINISHED. 10:34:05,749 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter -> Map (2/8) (2f7ff7feae62ead6c95de8adcbae446f) switched from RUNNING to FINISHED. 10:34:05,749 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter -> Map (8/8) (4cbc4b54611bc044378ef998f3684352) switched from RUNNING to FINISHED. 10:34:05,750 INFO org.apache.hudi.client.AbstractHoodieWriteClient - Generate a new instant time: 20210923103405 action: commit 10:34:05,751 INFO org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Creating a new instant [==>20210923103405commitREQUESTED] 10:34:05,753 INFO org.apache.flink.runtime.taskmanager.Task - Filter -> Map (6/8)#0 (1167445b24e5d29a6b9ed39e64ae8b7b) switched from RUNNING to FINISHED. 10:34:05,753 INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Filter -> Map (6/8)#0 (1167445b24e5d29a6b9ed39e64ae8b7b). 10:34:05,754 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Filter -> Map (6/8)#0 1167445b24e5d29a6b9ed39e64ae8b7b. 10:34:05,754 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter -> Map (6/8) (1167445b24e5d29a6b9ed39e64ae8b7b) switched from RUNNING to FINISHED. 10:34:05,755 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Loading HoodieTableMetaClient from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:05,764 INFO org.apache.hudi.common.table.HoodieTableConfig - Loading table properties from file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/hoodie.properties 10:34:05,765 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Finished Loading Table of type COPY_ON_WRITE(version=1, baseFileFormat=PARQUET) from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:05,767 INFO org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Loaded instants upto : Option{val=[==>20210923103405commitREQUESTED]} 10:34:05,768 INFO org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Checking for file exists ?file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/20210923103405.commit.requested 10:34:05,770 INFO org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Create new file for toInstant ?file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/20210923103405.inflight 10:34:05,770 INFO org.apache.hudi.sink.StreamWriteOperatorCoordinator - Create instant [20210923103405] for table [configure_area] with type [COPY_ON_WRITE] 10:34:05,770 INFO org.apache.hudi.sink.StreamWriteOperatorCoordinator - Executor executes action [initialize instant ] success! 10:34:05,945 INFO org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Loaded instants upto : Option{val=[==>20210923103405commitINFLIGHT]} Exception in thread "main" org.apache.hudi.exception.HoodieException: Get table avro schema error at org.apache.hudi.table.HoodieTableSource.getInputFormat(HoodieTableSource.java:322) at org.apache.hudi.table.HoodieTableSource.getInputFormat(HoodieTableSource.java:302) at org.apache.hudi.table.HoodieTableSource$1.produceDataStream(HoodieTableSource.java:190) at org.apache.flink.table.planner.plan.nodes.common.CommonPhysicalTableSourceScan.createSourceTransformation(CommonPhysicalTableSourceScan.scala:88) at org.apache.flink.table.planner.plan.nodes.physical.stream.StreamExecTableSourceScan.translateToPlanInternal(StreamExecTableSourceScan.scala:91) at org.apache.flink.table.planner.plan.nodes.physical.stream.StreamExecTableSourceScan.translateToPlanInternal(StreamExecTableSourceScan.scala:44) at org.apache.flink.table.planner.plan.nodes.exec.ExecNode$class.translateToPlan(ExecNode.scala:59) at org.apache.flink.table.planner.plan.nodes.physical.stream.StreamExecTableSourceScan.translateToPlan(StreamExecTableSourceScan.scala:44) at org.apache.flink.table.planner.plan.nodes.physical.stream.StreamExecLegacySink.translateToTransformation(StreamExecLegacySink.scala:158) at org.apache.flink.table.planner.plan.nodes.physical.stream.StreamExecLegacySink.translateToPlanInternal(StreamExecLegacySink.scala:82) at org.apache.flink.table.planner.plan.nodes.physical.stream.StreamExecLegacySink.translateToPlanInternal(StreamExecLegacySink.scala:48) at org.apache.flink.table.planner.plan.nodes.exec.ExecNode$class.translateToPlan(ExecNode.scala:59) at org.apache.flink.table.planner.plan.nodes.physical.stream.StreamExecLegacySink.translateToPlan(StreamExecLegacySink.scala:48) at org.apache.flink.table.planner.delegation.StreamPlanner$$anonfun$translateToPlan$1.apply(StreamPlanner.scala:66) at org.apache.flink.table.planner.delegation.StreamPlanner$$anonfun$translateToPlan$1.apply(StreamPlanner.scala:65) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234) at scala.collection.Iterator$class.foreach(Iterator.scala:891) at scala.collection.AbstractIterator.foreach(Iterator.scala:1334) at scala.collection.IterableLike$class.foreach(IterableLike.scala:72) at scala.collection.AbstractIterable.foreach(Iterable.scala:54) at scala.collection.TraversableLike$class.map(TraversableLike.scala:234) at scala.collection.AbstractTraversable.map(Traversable.scala:104) at org.apache.flink.table.planner.delegation.StreamPlanner.translateToPlan(StreamPlanner.scala:65) at org.apache.flink.table.planner.delegation.PlannerBase.translate(PlannerBase.scala:167) at org.apache.flink.table.api.internal.TableEnvironmentImpl.translate(TableEnvironmentImpl.java:1329) at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:707) at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeOperation(TableEnvironmentImpl.java:1107) at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeSql(TableEnvironmentImpl.java:666) at com.yuou.flinkhudi.util.flink.dwd.generate.ContryAreaCodeData$.generateContryAreaCodeData(ContryAreaCodeData.scala:93) at com.yuou.flinkhudi.util.flink.dwd.generate.ContryAreaCodeData$.main(ContryAreaCodeData.scala:101) at com.yuou.flinkhudi.util.flink.dwd.generate.ContryAreaCodeData.main(ContryAreaCodeData.scala) Caused by: org.apache.hudi.exception.InvalidTableException: Invalid Hoodie Table. file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area at org.apache.hudi.common.table.TableSchemaResolver.lambda$getTableParquetSchemaFromDataFile$0(TableSchemaResolver.java:88) at org.apache.hudi.common.util.Option.orElseThrow(Option.java:123) at org.apache.hudi.common.table.TableSchemaResolver.getTableParquetSchemaFromDataFile(TableSchemaResolver.java:88) at org.apache.hudi.common.table.TableSchemaResolver.getTableAvroSchemaFromDataFile(TableSchemaResolver.java:153) at org.apache.hudi.common.table.TableSchemaResolver.getTableAvroSchema(TableSchemaResolver.java:187) at org.apache.hudi.common.table.TableSchemaResolver.getTableAvroSchema(TableSchemaResolver.java:163) at org.apache.hudi.table.HoodieTableSource.getInputFormat(HoodieTableSource.java:320) ... 31 more

10:34:06,021 INFO org.apache.flink.runtime.taskmanager.Task - Filter -> Map (1/8)#0 (921bd3faa6059f2011630dc6c7cf6205) switched from RUNNING to FINISHED. 10:34:06,024 INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Filter -> Map (1/8)#0 (921bd3faa6059f2011630dc6c7cf6205). 10:34:06,024 INFO org.apache.flink.runtime.taskmanager.Task - bucket_assigner (1/8)#0 (1377c78b753cc343c4d864a472276ed9) switched from RUNNING to FINISHED. 10:34:06,025 INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for bucket_assigner (1/8)#0 (1377c78b753cc343c4d864a472276ed9). 10:34:06,024 INFO org.apache.flink.runtime.taskmanager.Task - bucket_assigner (7/8)#0 (cd6ba8fe96b84e26c7a0e9a0999a9e0c) switched from RUNNING to FINISHED. 10:34:06,025 INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for bucket_assigner (7/8)#0 (cd6ba8fe96b84e26c7a0e9a0999a9e0c). 10:34:06,025 INFO org.apache.flink.runtime.taskmanager.Task - bucket_assigner (3/8)#0 (84bcfbf44e9fa5c3877d1d4a9c0e40e1) switched from RUNNING to FINISHED. 10:34:06,025 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Filter -> Map (1/8)#0 921bd3faa6059f2011630dc6c7cf6205. 10:34:06,026 INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for bucket_assigner (3/8)#0 (84bcfbf44e9fa5c3877d1d4a9c0e40e1). 10:34:06,026 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task bucket_assigner (1/8)#0 1377c78b753cc343c4d864a472276ed9. 10:34:06,027 INFO org.apache.flink.runtime.taskmanager.Task - bucket_assigner (6/8)#0 (d4aeffa74f82b79361f229cb61dbc990) switched from RUNNING to FINISHED. 10:34:06,027 INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for bucket_assigner (6/8)#0 (d4aeffa74f82b79361f229cb61dbc990). 10:34:06,027 INFO org.apache.flink.runtime.taskmanager.Task - bucket_assigner (8/8)#0 (f55f88d3e637e42da3463df5ef5332a7) switched from RUNNING to FINISHED. 10:34:06,027 INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for bucket_assigner (8/8)#0 (f55f88d3e637e42da3463df5ef5332a7). 10:34:06,027 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter -> Map (1/8) (921bd3faa6059f2011630dc6c7cf6205) switched from RUNNING to FINISHED. 10:34:06,026 INFO org.apache.flink.runtime.taskmanager.Task - bucket_assigner (5/8)#0 (ba6f95731e0e4f8bf6748ce3cae87a70) switched from RUNNING to FINISHED. 10:34:06,028 INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for bucket_assigner (5/8)#0 (ba6f95731e0e4f8bf6748ce3cae87a70). 10:34:06,029 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - bucket_assigner (1/8) (1377c78b753cc343c4d864a472276ed9) switched from RUNNING to FINISHED. 10:34:06,028 INFO org.apache.flink.runtime.taskmanager.Task - bucket_assigner (2/8)#0 (991aeded53c2b1faea239c5f09c0f7ba) switched from RUNNING to FINISHED. 10:34:06,032 INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for bucket_assigner (2/8)#0 (991aeded53c2b1faea239c5f09c0f7ba). 10:34:06,027 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task bucket_assigner (7/8)#0 cd6ba8fe96b84e26c7a0e9a0999a9e0c. 10:34:06,032 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task bucket_assigner (3/8)#0 84bcfbf44e9fa5c3877d1d4a9c0e40e1. 10:34:06,033 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - bucket_assigner (7/8) (cd6ba8fe96b84e26c7a0e9a0999a9e0c) switched from RUNNING to FINISHED. 10:34:06,033 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task bucket_assigner (6/8)#0 d4aeffa74f82b79361f229cb61dbc990. 10:34:06,033 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task bucket_assigner (8/8)#0 f55f88d3e637e42da3463df5ef5332a7. 10:34:06,033 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task bucket_assigner (5/8)#0 ba6f95731e0e4f8bf6748ce3cae87a70. 10:34:06,034 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task bucket_assigner (2/8)#0 991aeded53c2b1faea239c5f09c0f7ba. 10:34:06,036 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - bucket_assigner (3/8) (84bcfbf44e9fa5c3877d1d4a9c0e40e1) switched from RUNNING to FINISHED. 10:34:06,037 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - bucket_assigner (6/8) (d4aeffa74f82b79361f229cb61dbc990) switched from RUNNING to FINISHED. 10:34:06,037 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - bucket_assigner (8/8) (f55f88d3e637e42da3463df5ef5332a7) switched from RUNNING to FINISHED. 10:34:06,037 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - bucket_assigner (5/8) (ba6f95731e0e4f8bf6748ce3cae87a70) switched from RUNNING to FINISHED. 10:34:06,039 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - bucket_assigner (2/8) (991aeded53c2b1faea239c5f09c0f7ba) switched from RUNNING to FINISHED. 10:34:06,069 INFO org.apache.flink.runtime.taskmanager.Task - bucket_assigner (4/8)#0 (f2738a17abb5e3b94d2aa4afc3982bfb) switched from RUNNING to FINISHED. 10:34:06,069 INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for bucket_assigner (4/8)#0 (f2738a17abb5e3b94d2aa4afc3982bfb). 10:34:06,069 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Loading HoodieTableMetaClient from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:06,073 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Loading HoodieTableMetaClient from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:06,074 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task bucket_assigner (4/8)#0 f2738a17abb5e3b94d2aa4afc3982bfb. 10:34:06,073 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Loading HoodieTableMetaClient from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:06,078 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - bucket_assigner (4/8) (f2738a17abb5e3b94d2aa4afc3982bfb) switched from RUNNING to FINISHED. 10:34:06,086 INFO org.apache.hudi.common.table.HoodieTableConfig - Loading table properties from file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/hoodie.properties 10:34:06,086 INFO org.apache.hudi.common.table.HoodieTableConfig - Loading table properties from file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/hoodie.properties 10:34:06,087 INFO org.apache.hudi.common.table.HoodieTableConfig - Loading table properties from file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/hoodie.properties 10:34:06,087 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Finished Loading Table of type COPY_ON_WRITE(version=1, baseFileFormat=PARQUET) from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:06,087 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Loading HoodieTableMetaClient from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:06,088 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Finished Loading Table of type COPY_ON_WRITE(version=1, baseFileFormat=PARQUET) from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:06,089 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Finished Loading Table of type COPY_ON_WRITE(version=1, baseFileFormat=PARQUET) from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:06,092 INFO org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Loaded instants upto : Option{val=[==>20210923103405commitINFLIGHT]} 10:34:06,093 INFO org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Loaded instants upto : Option{val=[==>20210923103405commitINFLIGHT]} 10:34:06,094 INFO org.apache.hudi.sink.StreamWriteFunction - No data to write in subtask [0] for instant [20210923103405] 10:34:06,095 INFO org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Loaded instants upto : Option{val=[==>20210923103405commitINFLIGHT]} 10:34:06,095 INFO org.apache.hudi.sink.StreamWriteFunction - No data to write in subtask [2] for instant [20210923103405] 10:34:06,096 INFO org.apache.hudi.sink.StreamWriteFunction - No data to write in subtask [3] for instant [20210923103405] 10:34:06,096 INFO org.apache.hudi.common.table.HoodieTableConfig - Loading table properties from file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/hoodie.properties 10:34:06,096 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Finished Loading Table of type COPY_ON_WRITE(version=1, baseFileFormat=PARQUET) from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:06,097 INFO org.apache.hudi.client.AbstractHoodieClient - Stopping Timeline service !! 10:34:06,097 INFO org.apache.hudi.client.embedded.EmbeddedTimelineService - Closing Timeline server 10:34:06,097 INFO org.apache.hudi.sink.StreamWriteOperatorCoordinator - Executor executes action [handle write metadata event for instant 20210923103405] success! 10:34:06,097 INFO org.apache.hudi.client.AbstractHoodieClient - Stopping Timeline service !! 10:34:06,098 INFO org.apache.hudi.sink.StreamWriteOperatorCoordinator - Executor executes action [handle write metadata event for instant 20210923103405] success! 10:34:06,097 INFO org.apache.hudi.client.AbstractHoodieClient - Stopping Timeline service !! 10:34:06,098 INFO org.apache.hudi.client.embedded.EmbeddedTimelineService - Closing Timeline server 10:34:06,098 INFO org.apache.hudi.sink.StreamWriteOperatorCoordinator - Executor executes action [handle write metadata event for instant 20210923103405] success! 10:34:06,098 INFO org.apache.hudi.client.embedded.EmbeddedTimelineService - Closing Timeline server 10:34:06,099 INFO org.apache.hudi.timeline.service.TimelineService - Closing Timeline Service 10:34:06,097 INFO org.apache.hudi.timeline.service.TimelineService - Closing Timeline Service 10:34:06,099 INFO io.javalin.Javalin - Stopping Javalin ... 10:34:06,098 INFO org.apache.hudi.timeline.service.TimelineService - Closing Timeline Service 10:34:06,099 INFO io.javalin.Javalin - Stopping Javalin ... 10:34:06,099 INFO io.javalin.Javalin - Stopping Javalin ... 10:34:06,100 INFO org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Loaded instants upto : Option{val=[==>20210923103405commitINFLIGHT]} 10:34:06,102 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Loading HoodieTableMetaClient from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:06,103 INFO org.apache.hudi.common.table.HoodieTableConfig - Loading table properties from file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/hoodie.properties 10:34:06,104 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Finished Loading Table of type COPY_ON_WRITE(version=1, baseFileFormat=PARQUET) from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:06,104 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Loading Active commit timeline for file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:06,107 INFO org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Loaded instants upto : Option{val=[==>20210923103405commitINFLIGHT]} 10:34:06,111 INFO io.javalin.Javalin - Javalin has stopped 10:34:06,111 INFO io.javalin.Javalin - Javalin has stopped 10:34:06,111 INFO org.apache.hudi.timeline.service.TimelineService - Closed Timeline Service 10:34:06,111 INFO org.apache.hudi.client.embedded.EmbeddedTimelineService - Closed Timeline server 10:34:06,111 INFO io.javalin.Javalin - Javalin has stopped 10:34:06,112 INFO org.apache.hudi.timeline.service.TimelineService - Closed Timeline Service 10:34:06,112 INFO org.apache.hudi.client.embedded.EmbeddedTimelineService - Closed Timeline server 10:34:06,111 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Loading HoodieTableMetaClient from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:06,111 INFO org.apache.hudi.timeline.service.TimelineService - Closed Timeline Service 10:34:06,112 INFO org.apache.hudi.client.embedded.EmbeddedTimelineService - Closed Timeline server 10:34:06,114 INFO org.apache.flink.runtime.taskmanager.Task - hoodie_stream_write (3/4)#0 (ff5491c88ffc17a816e22c29b6da47be) switched from RUNNING to FINISHED. 10:34:06,114 INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for hoodie_stream_write (3/4)#0 (ff5491c88ffc17a816e22c29b6da47be). 10:34:06,114 INFO org.apache.hudi.common.table.HoodieTableConfig - Loading table properties from file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/hoodie.properties 10:34:06,114 INFO org.apache.flink.runtime.taskmanager.Task - hoodie_stream_write (4/4)#0 (5e2085d96585101e586a7ea47bc56a98) switched from RUNNING to FINISHED. 10:34:06,114 INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for hoodie_stream_write (4/4)#0 (5e2085d96585101e586a7ea47bc56a98). 10:34:06,114 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task hoodie_stream_write (3/4)#0 ff5491c88ffc17a816e22c29b6da47be. 10:34:06,114 INFO org.apache.flink.runtime.taskmanager.Task - hoodie_stream_write (1/4)#0 (888768308836b8f4831890fa2934fe2c) switched from RUNNING to FINISHED. 10:34:06,115 INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for hoodie_stream_write (1/4)#0 (888768308836b8f4831890fa2934fe2c). 10:34:06,115 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task hoodie_stream_write (4/4)#0 5e2085d96585101e586a7ea47bc56a98. 10:34:06,115 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task hoodie_stream_write (1/4)#0 888768308836b8f4831890fa2934fe2c. 10:34:06,115 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Finished Loading Table of type COPY_ON_WRITE(version=1, baseFileFormat=PARQUET) from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:06,115 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Loading Active commit timeline for file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:06,115 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - hoodie_stream_write (3/4) (ff5491c88ffc17a816e22c29b6da47be) switched from RUNNING to FINISHED. 10:34:06,116 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - hoodie_stream_write (4/4) (5e2085d96585101e586a7ea47bc56a98) switched from RUNNING to FINISHED. 10:34:06,117 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - hoodie_stream_write (1/4) (888768308836b8f4831890fa2934fe2c) switched from RUNNING to FINISHED. 10:34:06,117 INFO org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Loaded instants upto : Option{val=[==>20210923103405commitINFLIGHT]} 10:34:06,118 INFO org.apache.hudi.common.table.view.FileSystemViewManager - Creating View Manager with storage type :REMOTE_FIRST 10:34:06,118 INFO org.apache.hudi.common.table.view.FileSystemViewManager - Creating remote first table view 10:34:06,143 INFO org.apache.hudi.table.marker.DirectWriteMarkers - Creating Marker Path=file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/.temp/20210923103405/70b872ee-bb13-4296-8d2b-e541ba27d704_1-4-0_20210923103405.parquet.marker.CREATE 10:34:06,145 INFO org.apache.hudi.table.marker.DirectWriteMarkers - [direct] Created marker file file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/.temp/20210923103405/70b872ee-bb13-4296-8d2b-e541ba27d704_1-4-0_20210923103405.parquet.marker.CREATE in 3 ms 10:34:06,256 WARN org.apache.hadoop.io.compress.zlib.ZlibFactory - Failed to load/initialize native-zlib library 10:34:06,256 INFO org.apache.hadoop.io.compress.CodecPool - Got brand-new compressor [.gz] 10:34:06,542 INFO org.apache.hudi.io.HoodieCreateHandle - New CreateHandle for partition : with fileId 70b872ee-bb13-4296-8d2b-e541ba27d704 10:34:06,563 INFO org.apache.hudi.common.util.queue.IteratorBasedQueueProducer - starting to buffer records 10:34:06,564 INFO org.apache.hudi.common.util.queue.BoundedInMemoryExecutor - starting consumer thread 10:34:06,588 INFO org.apache.hudi.common.util.queue.IteratorBasedQueueProducer - finished buffering records 10:34:06,599 INFO org.apache.hudi.io.HoodieCreateHandle - Closing the file 70b872ee-bb13-4296-8d2b-e541ba27d704 as we are done with all the records 1 10:34:07,010 INFO org.apache.hudi.io.HoodieCreateHandle - CreateHandle for partitionPath fileID 70b872ee-bb13-4296-8d2b-e541ba27d704, took 882 ms. 10:34:07,010 INFO org.apache.hudi.common.util.queue.BoundedInMemoryExecutor - Queue Consumption is done; notifying producer threads 10:34:07,013 INFO org.apache.hudi.client.AbstractHoodieClient - Stopping Timeline service !! 10:34:07,014 INFO org.apache.flink.runtime.taskmanager.Task - hoodie_stream_write (2/4)#0 (d48422b9607bf34237abcaf9cbca24a2) switched from RUNNING to FINISHED. 10:34:07,014 INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for hoodie_stream_write (2/4)#0 (d48422b9607bf34237abcaf9cbca24a2). 10:34:07,015 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task hoodie_stream_write (2/4)#0 d48422b9607bf34237abcaf9cbca24a2. 10:34:07,015 INFO org.apache.flink.runtime.taskmanager.Task - Sink: clean_commits (1/1)#0 (e46f7227496a98cb8360e4afa2fcdca1) switched from RUNNING to FINISHED. 10:34:07,015 INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Sink: clean_commits (1/1)#0 (e46f7227496a98cb8360e4afa2fcdca1). 10:34:07,016 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Sink: clean_commits (1/1)#0 e46f7227496a98cb8360e4afa2fcdca1. 10:34:07,016 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - hoodie_stream_write (2/4) (d48422b9607bf34237abcaf9cbca24a2) switched from RUNNING to FINISHED. 10:34:07,017 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: clean_commits (1/1) (e46f7227496a98cb8360e4afa2fcdca1) switched from RUNNING to FINISHED. 10:34:07,018 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job insert-into_default_catalog.default_database.configure_area (63fd2fc9f76ebcbf9b7d3d47dabbdf38) switched from state RUNNING to FINISHED. 10:34:07,018 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint coordinator for job 63fd2fc9f76ebcbf9b7d3d47dabbdf38. 10:34:07,019 INFO org.apache.hudi.client.AbstractHoodieWriteClient - Committing 20210923103405 action commit 10:34:07,020 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Loading HoodieTableMetaClient from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:07,020 INFO org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore - Shutting down 10:34:07,021 INFO org.apache.hudi.common.table.HoodieTableConfig - Loading table properties from file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/hoodie.properties 10:34:07,022 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Finished Loading Table of type COPY_ON_WRITE(version=1, baseFileFormat=PARQUET) from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:07,023 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Loading Active commit timeline for file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:07,025 INFO org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Loaded instants upto : Option{val=[==>20210923103405commitINFLIGHT]} 10:34:07,026 INFO org.apache.hudi.common.table.view.FileSystemViewManager - Creating View Manager with storage type :REMOTE_FIRST 10:34:07,026 INFO org.apache.hudi.common.table.view.FileSystemViewManager - Creating remote first table view 10:34:07,028 INFO org.apache.hudi.common.util.CommitUtils - Creating metadata for null numWriteStats:1numReplaceFileIds:0 10:34:07,028 INFO org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini Cluster 10:34:07,028 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job 63fd2fc9f76ebcbf9b7d3d47dabbdf38 reached globally terminal state FINISHED. 10:34:07,028 INFO org.apache.hudi.client.AbstractHoodieWriteClient - Committing 20210923103405 action commit 10:34:07,029 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest endpoint. 10:34:07,029 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor akka://flink/user/rpc/taskmanager_0. 10:34:07,030 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close ResourceManager connection 23667cd006bb26eb958d7cd585d4d7de. 10:34:07,031 INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Closing TaskExecutor connection a6e88966-162b-44b4-b2fd-39461a1a440c because: The TaskExecutor is shutting down. 10:34:07,040 INFO org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job insert-into_default_catalog.default_database.configure_area(63fd2fc9f76ebcbf9b7d3d47dabbdf38). 10:34:07,044 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 63fd2fc9f76ebcbf9b7d3d47dabbdf38. 10:34:07,045 INFO org.apache.hudi.client.AbstractHoodieClient - Stopping Timeline service !! 10:34:07,052 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl - Free slot TaskSlot(index:3, state:ALLOCATED, resource profile: ResourceProfile{managedMemory=16.000mb (16777216 bytes), networkMemory=8.000mb (8388608 bytes)}, allocationId: bc89ec13c8cfe5f30f33b9b92894ad6d, jobId: 63fd2fc9f76ebcbf9b7d3d47dabbdf38). 10:34:07,056 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl - Free slot TaskSlot(index:0, state:ALLOCATED, resource profile: ResourceProfile{managedMemory=16.000mb (16777216 bytes), networkMemory=8.000mb (8388608 bytes)}, allocationId: 764034c3267a443562b693e46aad20e5, jobId: 63fd2fc9f76ebcbf9b7d3d47dabbdf38). 10:34:07,057 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl - Free slot TaskSlot(index:6, state:ALLOCATED, resource profile: ResourceProfile{managedMemory=16.000mb (16777216 bytes), networkMemory=8.000mb (8388608 bytes)}, allocationId: 45b2be58c17c46712a1f99ffb71124c0, jobId: 63fd2fc9f76ebcbf9b7d3d47dabbdf38). 10:34:07,057 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl - Free slot TaskSlot(index:4, state:ALLOCATED, resource profile: ResourceProfile{managedMemory=16.000mb (16777216 bytes), networkMemory=8.000mb (8388608 bytes)}, allocationId: 3b5cadd7193ba9bd4dc2cf7ccc9667b2, jobId: 63fd2fc9f76ebcbf9b7d3d47dabbdf38). 10:34:07,057 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl - Free slot TaskSlot(index:2, state:ALLOCATED, resource profile: ResourceProfile{managedMemory=16.000mb (16777216 bytes), networkMemory=8.000mb (8388608 bytes)}, allocationId: 4a41e5491be9026da0456dd23f0709e4, jobId: 63fd2fc9f76ebcbf9b7d3d47dabbdf38). 10:34:07,058 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl - Free slot TaskSlot(index:5, state:ALLOCATED, resource profile: ResourceProfile{managedMemory=16.000mb (16777216 bytes), networkMemory=8.000mb (8388608 bytes)}, allocationId: 69e4facaa72255fa4011ad886be6e830, jobId: 63fd2fc9f76ebcbf9b7d3d47dabbdf38). 10:34:07,058 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl - Free slot TaskSlot(index:7, state:ALLOCATED, resource profile: ResourceProfile{managedMemory=16.000mb (16777216 bytes), networkMemory=8.000mb (8388608 bytes)}, allocationId: f738d448f48642d75b3bf69475df9c0a, jobId: 63fd2fc9f76ebcbf9b7d3d47dabbdf38). 10:34:07,058 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl - Free slot TaskSlot(index:1, state:ALLOCATED, resource profile: ResourceProfile{managedMemory=16.000mb (16777216 bytes), networkMemory=8.000mb (8388608 bytes)}, allocationId: 21a45995954d4f80f8e9559bd6c050c2, jobId: 63fd2fc9f76ebcbf9b7d3d47dabbdf38). 10:34:07,066 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService - Stop job leader service. 10:34:07,067 INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting down TaskExecutorLocalStateStoresManager. 10:34:07,077 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache directory C:\Users\zhujh\AppData\Local\Temp\3\flink-web-ui 10:34:07,080 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete. 10:34:07,084 INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Shut down cluster because application is in CANCELED, diagnostics DispatcherResourceManagerComponent has been closed.. 10:34:07,084 INFO org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent - Closing components. 10:34:07,084 INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl - FileChannelManager removed spill file directory C:\Users\zhujh\AppData\Local\Temp\3\flink-io-828c2b8c-9406-42ce-a880-da7d89a25952 10:34:07,085 INFO org.apache.flink.runtime.io.network.NettyShuffleEnvironment - Shutting down the network environment and its components. 10:34:07,085 INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess - Stopping SessionDispatcherLeaderProcess. 10:34:07,086 INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl - FileChannelManager removed spill file directory C:\Users\zhujh\AppData\Local\Temp\3\flink-netty-shuffle-d89eeb4b-bb89-4a97-9902-3a9b68d9d6e9 10:34:07,085 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher akka://flink/user/rpc/dispatcher_2. 10:34:07,086 INFO org.apache.flink.runtime.taskexecutor.KvStateService - Shutting down the kvState service and its components. 10:34:07,086 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all currently running jobs of dispatcher akka://flink/user/rpc/dispatcher_2. 10:34:07,087 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService - Stop job leader service. 10:34:07,087 INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl - Closing the SlotManager. 10:34:07,087 INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl - Suspending the SlotManager. 10:34:07,088 INFO org.apache.flink.runtime.filecache.FileCache - removed file cache directory C:\Users\zhujh\AppData\Local\Temp\3\flink-dist-cache-a14975c7-d8f8-413c-86c0-3b9990d84ec5 10:34:07,089 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor akka://flink/user/rpc/taskmanager_0. 10:34:07,163 INFO org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Marking instant complete [==>20210923103405commitINFLIGHT] 10:34:07,164 INFO org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Checking for file exists ?file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/20210923103405.inflight 10:34:07,166 INFO org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Create new file for toInstant ?file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/20210923103405.commit 10:34:07,166 INFO org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Completed [==>20210923103405commitINFLIGHT] 10:34:07,166 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Loading HoodieTableMetaClient from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:07,168 INFO org.apache.hudi.common.table.HoodieTableConfig - Loading table properties from file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/hoodie.properties 10:34:07,168 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Finished Loading Table of type COPY_ON_WRITE(version=1, baseFileFormat=PARQUET) from file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:07,169 INFO org.apache.hudi.common.table.HoodieTableMetaClient - Loading Active commit timeline for file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area 10:34:07,171 INFO org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Loaded instants upto : Option{val=[20210923103405commitCOMPLETED]} 10:34:07,172 INFO org.apache.hudi.common.table.view.FileSystemViewManager - Creating View Manager with storage type :MEMORY 10:34:07,172 INFO org.apache.hudi.common.table.view.FileSystemViewManager - Creating in-memory based Table View 10:34:07,184 INFO org.apache.hudi.table.marker.DirectWriteMarkers - Removing marker directory at file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/.temp/20210923103405 10:34:07,202 INFO org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Loaded instants upto : Option{val=[20210923103405commitCOMPLETED]} 10:34:07,204 INFO org.apache.hudi.table.HoodieTimelineArchiveLog - No Instants to archive 10:34:07,204 INFO org.apache.hudi.client.AbstractHoodieWriteClient - Committed 20210923103405 10:34:07,204 INFO org.apache.hudi.sink.StreamWriteOperatorCoordinator - Commit instant [20210923103405] success! 10:34:07,204 INFO org.apache.hudi.sink.StreamWriteOperatorCoordinator - Executor executes action [handle write metadata event for instant 20210923103405] success! 10:34:07,213 INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl - Suspending SlotPool. 10:34:07,213 INFO org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection 23667cd006bb26eb958d7cd585d4d7de: Stopping JobMaster for job insert-into_default_catalog.default_database.configure_area(63fd2fc9f76ebcbf9b7d3d47dabbdf38).. 10:34:07,213 INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl - Stopping SlotPool. 10:34:07,216 INFO org.apache.flink.runtime.rest.handler.legacy.backpressure.BackPressureRequestCoordinator - Shutting down back pressure request coordinator. 10:34:07,216 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher akka://flink/user/rpc/dispatcher_2. 10:34:07,219 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service. 10:34:07,262 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service. 10:34:07,262 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service. 10:34:07,277 INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache 10:34:07,278 INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache 10:34:07,280 INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:65389 10:34:07,280 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.

I guess it is because the cluster resource is not enough to start up all the write tasks, you can set up table option 'write.tasks' = '1' and try again.

set up table option 'write.tasks' = '1',try again,result is Only one to two pieces of data can be written。I Change to spark write write all

set up table option 'write.tasks' = '1',try again,result is Only one to two pieces of data can be written。I Change to spark write write all

@ycjunhua Looks like you got it resolved? can we close this?

Closing this as we have solution working. If you are still facing issues, feel free to re-open. or if you get past the issue by some other work around, do post it here so that it could benefit others in the community. thanks!

I am facing this issue even after updating the writer.task value to 1. FYI, I am using the Flink SQL Client on AWS EMR cluster. My Flink configuration JSON looks like this:

[
    {
      "Classification": "flink-conf",
      "Properties": {
        "taskmanager.numberOfTaskSlots":"4"
      }
    }
]

Should this configuration also have 1 in taskmanager.numberOfTaskSlots?

I am following this AWS Blog post - https://aws.amazon.com/blogs/big-data/create-a-low-latency-source-to-data-lake-pipeline-using-amazon-msk-connect-apache-flink-and-apache-hudi/

Any suggestions to resolution will be very helpful.

I created a new cluster with "taskmanager.numberOfTaskSlots":"1" and in hudi table definition, 'write.tasks' = '1', and it worked.

apache / hudi

[SUPPORT]flink hudi api use batch insert data happen error #3704