search

apache / incubator-streampark

Make stream processing easier! Easy-to-use streaming application development framework and operation platform.
https://streampark.apache.org/
Apache License 2.0
3.92k stars 1.01k forks source link

streamx-console on yarn submit error,can not found streamx-flink-sqlclient #472

Closed JiXiangKing closed 1 year ago

JiXiangKing commented 3 years ago

Please answer these questions before submitting your issue. Thanks!

Environment Description

Bug Description

streamx-console使用yarn提交FlinkSQL缺少streamx-flink-sqlclient-1.2.0.jar异常

Requirement or improvement

求解决

daixiaoyu commented 3 years ago

+1 !!!! 我现在也是卡在这个地方！欲哭无泪

wolfboys commented 3 years ago

please upload detail log.

附上详细的日志.

HugoSayHi commented 3 years ago

我也是这个问题

日志

2021-11-26 19:25:19,302 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -------------------------------------------------------------------------------- 2021-11-26 19:25:19,309 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Starting YarnApplicationClusterEntryPoint (Version: 1.14.0, Scala: 2.11, Rev:460b386, Date:2021-09-22T08:39:40+02:00) 2021-11-26 19:25:19,309 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - OS current user: root 2021-11-26 19:25:19,527 WARN org.apache.hadoop.util.NativeCodeLoader [] - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2021-11-26 19:25:19,585 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Current Hadoop/Kerberos user: root 2021-11-26 19:25:19,585 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JVM: Java HotSpot(TM) 64-Bit Server VM - Oracle Corporation - 1.8/25.311-b11 2021-11-26 19:25:19,585 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Maximum heap size: 981 MiBytes 2021-11-26 19:25:19,585 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JAVA_HOME: /opt/jdk1.8.0_311 2021-11-26 19:25:19,587 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Hadoop version: 3.3.0 2021-11-26 19:25:19,587 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JVM Options: 2021-11-26 19:25:19,587 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Xmx1073741824 2021-11-26 19:25:19,587 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Xms1073741824 2021-11-26 19:25:19,587 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -XX:MaxMetaspaceSize=268435456 2021-11-26 19:25:19,587 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlog.file=/opt/hadoop-3.3.0/logs/userlogs/application_1637920132948_0003/container_1637920132948_0003_01_000001/jobmanager.log 2021-11-26 19:25:19,587 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlog4j.configuration=file:log4j.properties 2021-11-26 19:25:19,587 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlog4j.configurationFile=file:log4j.properties 2021-11-26 19:25:19,587 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Program Arguments: 2021-11-26 19:25:19,589 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D 2021-11-26 19:25:19,589 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.off-heap.size=134217728b 2021-11-26 19:25:19,589 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D 2021-11-26 19:25:19,589 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.jvm-overhead.min=201326592b 2021-11-26 19:25:19,589 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D 2021-11-26 19:25:19,589 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.jvm-metaspace.size=268435456b 2021-11-26 19:25:19,589 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D 2021-11-26 19:25:19,589 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.heap.size=1073741824b 2021-11-26 19:25:19,590 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D 2021-11-26 19:25:19,590 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.jvm-overhead.max=201326592b 2021-11-26 19:25:19,590 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Classpath: :flink-1.14/streamx-flink-shims_flink-1.14-1.2.1.jar:lib/flink-csv-1.14.0.jar:lib/flink-json-1.14.0.jar:lib/flink-shaded-zookeeper-3.4.14.jar:lib/flink-table_2.11-1.14.0.jar:lib/log4j-1.2-api-2.14.1.jar:lib/log4j-api-2.14.1.jar:lib/log4j-core-2.14.1.jar:lib/log4j-slf4j-impl-2.14.1.jar:streamx-flink-sqlclient-1.2.1.jar:lib/flink-dist_2.11-1.14.0.jar:flink-conf.yaml::/opt/hadoop-3.3.0/etc/hadoop:/opt/hadoop-3.3.0/share/hadoop/common/hadoop-registry-3.3.0.jar:/opt/hadoop-3.3.0/share/hadoop/common/hadoop-nfs-3.3.0.jar:/opt/hadoop-3.3.0/share/hadoop/common/hadoop-common-3.3.0.jar:/opt/hadoop-3.3.0/share/hadoop/common/hadoop-kms-3.3.0.jar:/opt/hadoop-3.3.0/share/hadoop/common/hadoop-common-3.3.0-tests.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/zookeeper-jute-3.5.6.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/avro-1.7.7.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/javax.activation-api-1.2.0.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/hadoop-auth-3.3.0.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/commons-math3-3.1.1.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/kerby-pkix-1.0.1.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/log4j-1.2.17.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/jetty-webapp-9.4.20.v20190813.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/jersey-servlet-1.19.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/htrace-core4-4.1.0-incubating.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/audience-annotations-0.5.0.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/jcip-annotations-1.0-1.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/jetty-server-9.4.20.v20190813.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/kerb-simplekdc-1.0.1.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/accessors-smart-1.2.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/kerb-server-1.0.1.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/jackson-annotations-2.10.3.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/commons-logging-1.1.3.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/gson-2.2.4.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/jettison-1.1.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/commons-collections-3.2.2.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/commons-beanutils-1.9.4.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/httpclient-4.5.6.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/hadoop-annotations-3.3.0.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/asm-5.0.4.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/jetty-util-9.4.20.v20190813.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/kerby-xdr-1.0.1.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/kerb-core-1.0.1.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/kerby-util-1.0.1.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/kerb-identity-1.0.1.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/jetty-security-9.4.20.v20190813.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/jsch-0.1.55.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/commons-compress-1.19.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/curator-framework-4.2.0.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/jersey-core-1.19.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/commons-net-3.6.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/metrics-core-3.2.4.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/jersey-json-1.19.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/dnsjava-2.1.7.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/curator-recipes-4.2.0.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/jetty-io-9.4.20.v20190813.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/guava-27.0-jre.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/paranamer-2.3.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/curator-client-4.2.0.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/jsr311-api-1.1.1.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/commons-codec-1.11.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/kerb-client-1.0.1.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/jetty-xml-9.4.20.v20190813.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/stax2-api-3.1.4.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/token-provider-1.0.1.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/hadoop-shaded-protobuf_3_7-1.0.0.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/slf4j-api-1.7.25.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/httpcore-4.4.10.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/commons-configuration2-2.1.1.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/woodstox-core-5.0.3.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/kerb-util-1.0.1.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/commons-lang3-3.7.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/commons-daemon-1.0.13.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/javax.servlet-api-3.1.0.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/kerb-admin-1.0.1.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/jaxb-api-2.2.11.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/jackson-databind-2.10.3.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/checker-qual-2.5.2.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/j2objc-annotations-1.1.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/kerb-common-1.0.1.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/jetty-http-9.4.20.v20190813.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/jersey-server-1.19.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/kerby-asn1-1.0.1.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/json-smart-2.3.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/animal-sniffer-annotations-1.17.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/jackson-core-2.10.3.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/commons-cli-1.2.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/commons-text-1.4.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/kerby-config-1.0.1.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/netty-3.10.6.Final.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/jsr305-3.0.2.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/commons-io-2.5.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/re2j-1.1.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/zookeeper-3.5.6.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/failureaccess-1.0.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/nimbus-jose-jwt-7.9.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/jsp-api-2.1.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/snappy-java-1.0.5.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/jul-to-slf4j-1.7.25.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/jetty-servlet-9.4.20.v20190813.jar:/opt/hadoop-3.3.0/share/hadoop/common/lib/kerb-crypto-1.0.1.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/hadoop-hdfs-nfs-3.3.0.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/hadoop-hdfs-native-client-3.3.0.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/hadoop-hdfs-client-3.3.0-tests.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/hadoop-hdfs-rbf-3.3.0-tests.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/hadoop-hdfs-httpfs-3.3.0.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/hadoop-hdfs-3.3.0-tests.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/hadoop-hdfs-rbf-3.3.0.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/hadoop-hdfs-native-client-3.3.0-tests.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/hadoop-hdfs-client-3.3.0.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/hadoop-hdfs-3.3.0.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/zookeeper-jute-3.5.6.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/avro-1.7.7.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/javax.activation-api-1.2.0.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/hadoop-auth-3.3.0.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/commons-math3-3.1.1.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/kerby-pkix-1.0.1.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/jetty-webapp-9.4.20.v20190813.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/jersey-servlet-1.19.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/htrace-core4-4.1.0-incubating.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/audience-annotations-0.5.0.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/jcip-annotations-1.0-1.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/jetty-server-9.4.20.v20190813.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/kerb-simplekdc-1.0.1.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/accessors-smart-1.2.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/kerb-server-1.0.1.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/jackson-annotations-2.10.3.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/jaxb-impl-2.2.3-1.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/gson-2.2.4.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/jettison-1.1.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/commons-collections-3.2.2.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/commons-beanutils-1.9.4.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/httpclient-4.5.6.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/hadoop-annotations-3.3.0.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/asm-5.0.4.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/jetty-util-9.4.20.v20190813.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/kerby-xdr-1.0.1.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/jetty-util-ajax-9.4.20.v20190813.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/kerb-core-1.0.1.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/kerby-util-1.0.1.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/kerb-identity-1.0.1.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/jetty-security-9.4.20.v20190813.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/jsch-0.1.55.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/commons-compress-1.19.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/curator-framework-4.2.0.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/jersey-core-1.19.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/commons-net-3.6.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/jackson-jaxrs-1.9.13.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/jersey-json-1.19.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/dnsjava-2.1.7.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/curator-recipes-4.2.0.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/jetty-io-9.4.20.v20190813.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/guava-27.0-jre.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/okhttp-2.7.5.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/paranamer-2.3.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/curator-client-4.2.0.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/jsr311-api-1.1.1.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/json-simple-1.1.1.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/commons-codec-1.11.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/netty-all-4.1.50.Final.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/kerb-client-1.0.1.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/jetty-xml-9.4.20.v20190813.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/stax2-api-3.1.4.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/jackson-xc-1.9.13.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/token-provider-1.0.1.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/hadoop-shaded-protobuf_3_7-1.0.0.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/httpcore-4.4.10.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/commons-configuration2-2.1.1.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/woodstox-core-5.0.3.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/kerb-util-1.0.1.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/commons-lang3-3.7.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/okio-1.6.0.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/javax.servlet-api-3.1.0.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/kerb-admin-1.0.1.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/jaxb-api-2.2.11.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/jackson-databind-2.10.3.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/checker-qual-2.5.2.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/j2objc-annotations-1.1.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/kerb-common-1.0.1.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/jetty-http-9.4.20.v20190813.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/jersey-server-1.19.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/kerby-asn1-1.0.1.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/json-smart-2.3.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/animal-sniffer-annotations-1.17.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/jackson-core-2.10.3.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/commons-text-1.4.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/kerby-config-1.0.1.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/netty-3.10.6.Final.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/jsr305-3.0.2.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/commons-io-2.5.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/re2j-1.1.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/zookeeper-3.5.6.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/failureaccess-1.0.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/nimbus-jose-jwt-7.9.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/snappy-java-1.0.5.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/jetty-servlet-9.4.20.v20190813.jar:/opt/hadoop-3.3.0/share/hadoop/hdfs/lib/kerb-crypto-1.0.1.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/hadoop-yarn-server-tests-3.3.0.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/hadoop-yarn-services-api-3.3.0.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/hadoop-yarn-server-web-proxy-3.3.0.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/hadoop-yarn-api-3.3.0.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/hadoop-yarn-client-3.3.0.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-3.3.0.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/hadoop-yarn-services-core-3.3.0.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/hadoop-yarn-applications-mawo-core-3.3.0.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/hadoop-yarn-server-common-3.3.0.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-3.3.0.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/hadoop-yarn-common-3.3.0.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/hadoop-yarn-registry-3.3.0.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/hadoop-yarn-server-timeline-pluginstorage-3.3.0.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/hadoop-yarn-server-router-3.3.0.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-3.3.0.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-3.3.0.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-3.3.0.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-3.3.0.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/bcprov-jdk15on-1.60.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/jackson-module-jaxb-annotations-2.10.3.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/asm-tree-7.1.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/asm-analysis-7.1.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/jetty-jndi-9.4.20.v20190813.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/jetty-plus-9.4.20.v20190813.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/swagger-annotations-1.5.4.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/websocket-server-9.4.20.v20190813.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/aopalliance-1.0.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/guice-4.0.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/metrics-core-3.2.4.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/jna-5.2.0.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/HikariCP-java7-2.4.12.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/asm-commons-7.1.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/jline-3.9.0.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/jackson-jaxrs-base-2.10.3.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/snakeyaml-1.16.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/jersey-client-1.19.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/javax.websocket-api-1.0.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/websocket-servlet-9.4.20.v20190813.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/websocket-common-9.4.20.v20190813.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/jakarta.xml.bind-api-2.3.2.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/jetty-client-9.4.20.v20190813.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/guice-servlet-4.0.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/json-io-2.5.1.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/java-util-1.9.0.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/javax.inject-1.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/jakarta.activation-api-1.2.1.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/javax-websocket-server-impl-9.4.20.v20190813.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/websocket-api-9.4.20.v20190813.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/bcpkix-jdk15on-1.60.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/jersey-guice-1.19.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/jackson-jaxrs-json-provider-2.10.3.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/javax-websocket-client-impl-9.4.20.v20190813.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/ehcache-3.3.1.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/websocket-client-9.4.20.v20190813.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/objenesis-2.6.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/fst-2.50.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/jetty-annotations-9.4.20.v20190813.jar:/opt/hadoop-3.3.0/share/hadoop/yarn/lib/javax.websocket-client-api-1.0.jar 2021-11-26 19:25:19,592 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -------------------------------------------------------------------------------- 2021-11-26 19:25:19,594 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Registered UNIX signal handlers for [TERM, HUP, INT] 2021-11-26 19:25:19,599 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - YARN daemon is running as: root Yarn client user obtainer: root 2021-11-26 19:25:19,612 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.memory.process.size, 1728m 2021-11-26 19:25:19,613 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: state.checkpoints.num-retained, 1 2021-11-26 19:25:19,613 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: yarn.flink-dist-jar, hdfs://hdp1:9000/streamx/flink/flink-1.14.0/lib/flink-dist_2.11-1.14.0.jar 2021-11-26 19:25:19,613 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: classloader.resolve-order, parent-first 2021-11-26 19:25:19,613 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.execution.failover-strategy, region 2021-11-26 19:25:19,613 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: high-availability.cluster-id, application_1637920132948_0003 2021-11-26 19:25:19,613 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.address, localhost 2021-11-26 19:25:19,614 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.target, yarn-application 2021-11-26 19:25:19,614 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.memory.process.size, 1600m 2021-11-26 19:25:19,614 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.port, 6123 2021-11-26 19:25:19,614 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: yarn.application.type, StreamX Flink 2021-11-26 19:25:19,614 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.savepoint.ignore-unclaimed-state, false 2021-11-26 19:25:19,614 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.attached, true 2021-11-26 19:25:19,614 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: yarn.provided.lib.dirs, hdfs://hdp1:9000/streamx/flink/flink-1.14.0/lib;hdfs://hdp1:9000/streamx/jars;hdfs://hdp1:9000/streamx/plugins;hdfs://hdp1:9000/streamx/shims/flink-1.14 2021-11-26 19:25:19,615 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: internal.cluster.execution-mode, NORMAL 2021-11-26 19:25:19,615 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: $internal.application.program-args, --flink.conf;eNq9Wm1v28i1/u5fMXCAOgEkyna221TtXUBx5MYbrx1Y3u7dLS6CETmSuCY5LIe0o6I/vs9zZvgi2+u0RXyzi0QSZ87bnPOcl+GLF1/3z94Lpc7T2BTOJKq2qt4YNSt1jH8WdlXf6cqoU9sUia5TW6iXs8XpK4WvplK2MNxtK5VbrIptUVfpsqnxQ+YpKr2ujMlNUbtIqYUxQv7i8vrsZK5WaSb7k9T5fRDgLq03WJM6dWerG7UCKZ0kKVnrTKUFfshFEG6szFpXSVqswbrcVul6Uyt7V5jKbdIS/K6pyuK0FcZ5wi1b6Lq1TVBloHUwxkj9FYSo8nF0qF5iATfth6f7r/4ku3O9VYWtVeNMT12Zz7Epa4gLwfIyS3URy+6gXccDMv4ciNhlrbFeiyrKrobLlK735Jz4Z1PX5XQyubu7i7QIHNlqPWlVnJzDsheL+RhC+z0/FplxDrb6e5NWsPByq3QJmWK9hKSZvuP5yTHJ8UOGuwr2LtYj5cL53z+k3mStgFB8uABG04Xany3U2WJfvZ0tzhYjEvnp7Pr95Y/X6qfZ1dXs4vpsvlCXV+rk8uLd2fXZ5QW+narZxc/qw9nFu5EysBb4mM9lRQ0gZkpjmiQirdaZWhHoKvzuShOnqzSGasW60Wuj1vbWVAXdpDRVnjoeqoOACchkaZ7W4lDuoVrg87WDbW/vxf981T/Q4cTmOQPiKxMGZQaQ+VzDegg+xKE/B++bG+tqHvTdJo29U39vlz/oAhavVNV4C6sYfrCkA1WGvirux7XX2t2ExX6hLrYqxuECKQLJO13U9EjASmHiOoI0cDNnajonKOKLLbItQy+h2y5q0NEZQAlwlBihyshaGkUHoFfXpqDI94R1aUIJIZn3nS1dhWvGY1Hyz/y70Ln5TpW6wr81sc9bYZkWk1/tMvekIreBvUzc1AwuuulZoTbAJaVvdZrpZZql9VbEG6l05fHHmY6Sq3VVj+OscbUn5uIqBZBQFSjelKDItTDJapJrrvKIMwqYmWYZ9a31DTSNCd2QUwORCZqxzrJtpH7WFdFz51ehmK6byvRnS43VUjsfz+3P8mtQvqCZ7xCjsgs073lAtLc3sE1VxlHwoanKLPiSXutmVx9PVGmruqc3pJY670DerPepct9UfXt0/HqvJVfbGi5bVjamy+YGCQrHm/6jx4meeiRAeWHrAOE6jpHv4IeSfWDRsL1xRBNiePrAhwInnGqB45Oc9P1ff8DOWjugtPdGK3hGZ9wYnezq4XlEgU5EUafq6NvDw/w/0GkQVf+1UgMa/6VWeHjztFp/OH6Ti1aWqRKUzWN0A8WRKjOjmZAlVMQIp1la3OyYIC0QDTqhax58QYADCcyaTsXUXRkkaZQoiU+AiDO1hE5fJiNSDiXxNn9k24qLWuWP3xzm7ZEWTb4MYIJdymW2ZpWia0Vv3zkLu1oh2iM15wMu9CBLuCMqZZmBb6SlAStz7xA8l8sVyS3IAlK0ErR7U5d7JKV/QM01gC6IkqSJGCqg4+DQB5vBcvgtMSvdZPWAUfjFF0hui9PKAW8bFIce/5t6YwHRNKLC/2+3uztKXW+c+Klt6m5jxYMHCqJCYN1RmQyIdmvaOlZQhsnH2l3GB/yCKmpyEKkf29INm+hzFdKB7G75U7yOi6SywMXLNGSqYSyeE9LYkB+LH9rVfNaoYIw62CQrB/b5lnBKGJ0CvL75/YE40Mq15ht7PZ+jaHjPrDQbZKXnqh+Y/sYP0l+kPloUYixBbenLLx7mwcXlxfyApd7BP6y9MQYV24EPqwd0pqpb0jsz4tYnEGIJWhYtdvepUiIdB7xl5Jcs7vFrEqmfNjypX6z9IMSUQwNjXEi1LidYrit2QKqu4KVCEecS35QWbiHuAYBi7WgyFCpQJqRjup80TTsUM11JPC9/xWJga5bemF4cRaFXmb0DT11uXAiHH1ASMLPDwZpKKvehO0uYepA3waqryuaC8/Qusn4pfN6/O12M1OL1SJ2YcjNSxQoSRFH0Sj1u5IiiA0TepdVUBa+dCJxNNnrS2h0hXxPEehv+vbFVk0MtVigiXmwtezVdhxLjPieQkhIn1Hl5p3BLnLvY/k2xcp+lw9HUF4wfkf5H/OF4+AOU2lcv2xjuH0zV8dGbo1e/oW7nUpHXYFCpTLlPkvHs5HzHa7siib0ZLdRTGbRoiY0n1evoKDrun3/0QJsT2Td1nr1w8ae3TZqhxAWThUS/89nKV9JtU7Qfox7C0UDFXy4vP51czWfX80+z8/NP2PeKAbRvS1OEx5cf5xd88OnHi8XsdP7qHiTf6qyRHi7sEcDrOKLqKtY+N/ZcUbz+8gEHFjfEbO41Bd0y+aJd/UlEOs6miuyeA9xORa3aZqZi6+07kS5ipX14HrBb6hiVd+I9vq3GmzBZERSgzhVtiK+MhV4sB6OCzI6cA8NG6uQ3nhDxitB3wCejHQqRZC6csPpOHXoknbcr7/GSRAZyXZODauOjlF54tGJrbAcynEjHIKbtCO5IeBkiZNXOhxJAcpo5L8SXxJ2q13laPLGw7UtRVCXj/tGYlUDB9VP1t3fz8znC4vLi08ns4mR+fj7jmGGkrubXs7OL+7//3xPccv15jB4J7s7cPuAntdQT+9JiXGp4wFQdPrWMJYD62/x/ZyfX5z9DsJP5SM2uP53PZ4tr+fqUcHWaG1RFkOTwaZv5iIDPjFc4iR27uacFbGjpdWGSqVrpzBk5w0VTsvViV+/9PiTxvq05GPlSy+cpfkMBfeOSJT76ngVk/hxn2rkxS6GxXUG0GOGx/c77iURJFOhPVU+MIYesZGTxvZzsButGPjwaRxfnlCGkkhb8lkjsglshIFtVhuwHlKNkkAnb6k3mBFPawufGoV1FzsCrZupnQT0U2+lb45eOQlbR2ZB5//zf492vJ+vTTK8ZuB4rJknqpHpAQ1fJXBbAsGM3CNQdJlGMYvhj/s09vrKgTa94uO/e7lryVaQenmQ0INa6VMBQuibLNGwAUJr1Fu1nZKKR2qAoIhe4l8xVGz+4a8s652seaaRIo0HJxerpkkMifOZsRZ6GgoSzoQ1sBYiGf2iU7XHdD6iGZEbtkGtbhnGJ74clNSf2Dq0n8mIeiBMRSysgJGubcudxKu6XSpOVNHGo+HwzimKjYG0YUmfmO3vgjmty8YzdmUEfrK3Nxq3NphyOc0z+DNn1CrZUv1N3ZkmLA685SX2efCp+B+/th4xX88V1qObaySA7t0idreSQo2VaJGPZt9E8H3aucsJhMGwSVufGDzsccg3s7TN1WoQLELYHJKDRcJrMB6PQ9oOmN4dvuq62HYr+poxCOgiKVR2pbhJ2GMl/JMjyVFWstrqJjpCiR9HaQVrwCrL2knVai3iH4zeHfzx8ICO9viP6uyFJbndD8YTeYzK2eNIOAwCuUpAyKF2zDOP1YXXioxJswW8spTJ76KZg1kJhUKRAQnThhZ/CyHEHlIK3v8CmSOjWkSc4QIunZIlZ+GWZR4ivKo2n/ECarx5ms+SWnJ4lti535hwhHaXG4z+SJjxJMz0xi0po9fOfNoCI6JJgx92Ny/fArcHuPs29/BVPotRGdV4mHvpQBdfbVzwZGVb7hHcK7isWn3L5J+0gJ1wysh6FUZsE1O7wGqh8A5gNUvEaUqe8BTwQYXb0awdILAQKE8Zd7fBbe4h9IcZP2GsbuR/CMmlCpZJFHk85wxlQHYXqQhDFd+Sd7swQgUqlXsYWCK8OpgfUqinSz9Kq8dIvz/VImWgdTcNF34Rp4WgCi03l43H/8TU/dvPdqR8J9taG2/oZR8WBqB8EEEHCBQjhY7szqTqbXMpsgusjuZFk6xdynNeKU/+eQ2cERo3j5Qt6e49M0iHyGLo1oB5oIzeuNQe17Vwx0Astf+p2hmRoR8wt74DwY9tTgo5t1hukfnU1O3sXijTvWKyOgFVim4B8UlhmVie+vXE2Q7oXUQfzJ+l+Q+Uab9IsGa9AqD5QL8XhDlxbKrJtpiEP0CCxCWiX0e0Hq7xMJ6SkZMmuGPBYe+fYFFaSNjjU7o8iQY9cJKaIt5MsXTKMQOvWX0SLoX3tEG5wBdxgS/5leQ3rs5rw4ywsUgs4PJQCXxZePGV7X36pg0xW+tvpxCyb9ZobelFwMq4xwdidMrx88SYdi0mnamC9LvfkvHVgzR2G9WsrkeLns4WpfaTXEI5eYFw7E6eFGoluCVNJ5KpueI0bITp/bVwdQi5vb/mQYpGtiDy8eGfbysuvQu2foX5aAaAkIXvyoIeHLf9lI8P1fQVUJPwPhyPoqOiZ337zw9vRTuOAlpAPjv7yNszoHhn8BwYRQC32PelhdPT0UvCbglu+/MIy/Rn93nr5LOMTAdoTfw2pFu2Q52QIk8+RlT6YCkdjnVwGsH4OHk5UuNVVahsnhb8t5Jp4rN7rxNpy1M8dR37U48stCycaE4m8e7QVQEqCDdsLUzqi7VF07/pTRn7qplr+PuKD9o2R44iJ65Zps5MUcJf4Sh99UJjNaXVjtrVeemiHFjeGwzS+W3I3UTcpagxCyesIkoXGaUimL/4RJa3a389mC8i1lldKUHJ/rlnbfnNf8k7zFlm4b7KYLc67CZXhbLnfxabqUW2Ih0FdJIVZq9POUKu/dCM07qrq+5x2m0zmpTOqkFfSku8TVKy/a5ZV3SAxugmiRKJrBC5jT3UsVKccwZsnNnh2yAJkOKntpH0+8U+e2NpJhppOGmlCdJdJhr4fjAggQJnRvq7w2Ak9wa1dM0WcEZdGH/TqRvvPzxHTv3z4fwzktztOpvtJ+eDNIz9B5ms2uXx1vVP6qqy13E69unxIma7exmUMyEK5I6Pp6jaNjX+LAbx64iDXT6OddlkU1soE6pFbpcfOXq4nUIHi4HkDG2ZKoZTgFTLcYP9LZ7//UBRZMA4LgkDP5xTvU86ktwtpAp+rh99hwnOWSYxJ/FsttS1LfL5NtbwBs/GLfVvKN2Beyup/ct2r3ZEfEa5kIeJfspMLYHR+fhrA+l0a+WS4vu7vqpgXfLfHCcygQwhHuSt1mARAGhN8kGXeYBSjKxQ/tyZa7Q7pJp1oY4o2ud+S+1fO+slB15Te40+hDV+oebFrIPajj3Xp3ezkazDoxgrHe+FtMw0X5y1B1xnBaEMbwtTBuKG/Gp7PAx7/ge3O2ssMhFeOTJQixCxHF2RTmRUMsWk7sUeP9ynmYf+4v4I4OsSfvb1/AXIodSw=;--app.name;test333;--parallelism.default;1;--sql;eNqtUbFOwzAQ3Sv1H24zSEmUDkxVh1AFiIBUSix1rExyKRaOHWwj+Hyc1BGNqMKCF9v33r17d7ct0oSmQJPbpxRqZtkRJVwtF+BOczD4/oGyQshyGoxBzWSt2guhg7EaSlpk+b1HrIGkBKEqJixv0VjWdh7au7LFc1I8wt2u8ERreuwa9hl9GE2QSkmJlVWawAaIt0i8ShiC6ixXkgn/MC7mM7X6NGGHOjToRGqyITdjHmk4itpEPy1Gb3ygjP8ZpmtDW0ddzXBwEFvFcfybdJpW1HJ5WWTE2dcfEv3AI4HyaF8HJhnGt14u+nt7vtlOc2kPlr0I/IftnoDZPQ0FJ36yvEwL2gvvJnYMCpd2ZicYKwaT0o12tvz619+aHMia 2021-11-26 19:25:19,616 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.shutdown-on-attached-exit, false 2021-11-26 19:25:19,616 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: pipeline.jars, hdfs://hdp1:9000/streamx/plugins/streamx-flink-sqlclient-1.2.1.jar 2021-11-26 19:25:19,616 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: parallelism.default, 1 2021-11-26 19:25:19,616 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.numberOfTaskSlots, 1 2021-11-26 19:25:19,617 WARN org.apache.flink.configuration.GlobalConfiguration [] - Error while trying to split key and value in configuration file /data/hdfs/tmp/nm-local-dir/usercache/root/appcache/application_1637920132948_0003/container_1637920132948_0003_01_000001/flink-conf.yaml:21: "pipeline.classpaths: " 2021-11-26 19:25:19,617 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: yarn.application.name, test333 2021-11-26 19:25:19,617 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: $internal.deployment.config-dir, /opt/flink-1.14.0/conf 2021-11-26 19:25:19,617 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: $internal.yarn.log-config-file, /opt/flink-1.14.0/conf/log4j.properties 2021-11-26 19:25:19,645 WARN org.apache.flink.configuration.Configuration [] - Config uses deprecated configuration key 'web.port' instead of proper key 'rest.bind-port' 2021-11-26 19:25:19,664 INFO org.apache.flink.runtime.clusterframework.BootstrapTools [] - Setting directories for temporary files to: /data/hdfs/tmp/nm-local-dir/usercache/root/appcache/application_1637920132948_0003 2021-11-26 19:25:19,696 ERROR org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Could not create application program. org.apache.flink.util.FlinkException: Could not load the provided entrypoint class. at org.apache.flink.client.program.DefaultPackagedProgramRetriever.getPackagedProgram(DefaultPackagedProgramRetriever.java:203) ~[flink-dist_2.11-1.14.0.jar:1.14.0] at org.apache.flink.yarn.entrypoint.YarnApplicationClusterEntryPoint.getPackagedProgram(YarnApplicationClusterEntryPoint.java:125) ~[flink-dist_2.11-1.14.0.jar:1.14.0] at org.apache.flink.yarn.entrypoint.YarnApplicationClusterEntryPoint.main(YarnApplicationClusterEntryPoint.java:95) [flink-dist_2.11-1.14.0.jar:1.14.0] Caused by: org.apache.flink.client.program.ProgramInvocationException: JAR file does not exist '/data/hdfs/tmp/nm-local-dir/usercache/root/appcache/application_1637920132948_0003/container_1637920132948_0003_01_000001/streamx-flink-sqlclient-1.2.1.jar' at org.apache.flink.client.program.PackagedProgram.checkJarFile(PackagedProgram.java:617) ~[flink-dist_2.11-1.14.0.jar:1.14.0] at org.apache.flink.client.program.PackagedProgram.loadJarFile(PackagedProgram.java:465) ~[flink-dist_2.11-1.14.0.jar:1.14.0] at org.apache.flink.client.program.PackagedProgram.(PackagedProgram.java:135) ~[flink-dist_2.11-1.14.0.jar:1.14.0] at org.apache.flink.client.program.PackagedProgram.(PackagedProgram.java:65) ~[flink-dist_2.11-1.14.0.jar:1.14.0] at org.apache.flink.client.program.PackagedProgram$Builder.build(PackagedProgram.java:691) ~[flink-dist_2.11-1.14.0.jar:1.14.0] at org.apache.flink.client.program.DefaultPackagedProgramRetriever.getPackagedProgram(DefaultPackagedProgramRetriever.java:201) ~[flink-dist_2.11-1.14.0.jar:1.14.0] ... 2 more Caused by: java.io.IOException: JAR file does not exist '/data/hdfs/tmp/nm-local-dir/usercache/root/appcache/application_1637920132948_0003/container_1637920132948_0003_01_000001/streamx-flink-sqlclient-1.2.1.jar' at org.apache.flink.util.JarUtils.checkJarFile(JarUtils.java:46) ~[flink-dist_2.11-1.14.0.jar:1.14.0] at org.apache.flink.client.program.PackagedProgram.checkJarFile(PackagedProgram.java:615) ~[flink-dist_2.11-1.14.0.jar:1.14.0] at org.apache.flink.client.program.PackagedProgram.loadJarFile(PackagedProgram.java:465) ~[flink-dist_2.11-1.14.0.jar:1.14.0] at org.apache.flink.client.program.PackagedProgram.(PackagedProgram.java:135) ~[flink-dist_2.11-1.14.0.jar:1.14.0] at org.apache.flink.client.program.PackagedProgram.(PackagedProgram.java:65) ~[flink-dist_2.11-1.14.0.jar:1.14.0] at org.apache.flink.client.program.PackagedProgram$Builder.build(PackagedProgram.java:691) ~[flink-dist_2.11-1.14.0.jar:1.14.0] at org.apache.flink.client.program.DefaultPackagedProgramRetriever.getPackagedProgram(DefaultPackagedProgramRetriever.java:201) ~[flink-dist_2.11-1.14.0.jar:1.14.0] ... 2 more

HugoSayHi commented 3 years ago

+1 !!!! 我现在也是卡在这个地方！欲哭无泪

换hadoop版本 2.10.1 试试

HugoSayHi commented 3 years ago

Please answer these questions before submitting your issue. Thanks!

Environment Description

  • StreamX Version: streamx-console-service-1.2.0
  • JVM version (java -version):1.8
  • OS version (uname -a if on a Unix-like system):CentOS7

Bug Description

streamx-console使用yarn提交FlinkSQL缺少streamx-flink-sqlclient-1.2.0.jar异常

Requirement or improvement

求解决

换hadoop版本 2.10.1 试试

lvshaokang commented 3 years ago

i can try this issue.

hackallan commented 2 years ago

可以切换一下flink 版本试试，我目前1.2.1main分支拉取下来的代码，1.12 flink版本可以跑，1.14，1.13都是这个缺少streamx-flink-sqlclient包的问题。

gitfortian commented 2 years ago

hadoop3.1 flink 1.14.3 也是报这个错

wolfboys commented 1 year ago

fixed