search

apache / seatunnel

SeaTunnel is a next-generation super high-performance, distributed, massive data integration tool.
https://seatunnel.apache.org/
Apache License 2.0
7.95k stars 1.8k forks source link

[Bug] [Set Up with Kubernetes, JDBC as source] According to the official website document, the data synchronization with MySQL as the source failed. #2018

Closed ChenpiDog closed 2 years ago

ChenpiDog commented 2 years ago

Search before asking

What happened

Set Up with Kubernetes, JDBC as source, based on the Flink engine, the task failed.

Dockerfile： `FROM flink:1.13

ENV SEATUNNEL_VERSION="2.1.0"

RUN wget https://archive.apache.org/dist/incubator/seatunnel/${SEATUNNEL_VERSION}/apache-seatunnel-incubating-${SEATUNNEL_VERSION}-bin.tar.gz RUN tar -xzvf apache-seatunnel-incubating-${SEATUNNEL_VERSION}-bin.tar.gz

RUN mkdir -p $FLINK_HOME/usrlib RUN cp apache-seatunnel-incubating-${SEATUNNEL_VERSION}/lib/seatunnel-core-flink.jar $FLINK_HOME/usrlib/seatunnel-core-flink.jar

RUN rm -fr apache-seatunnel-incubating-${SEATUNNEL_VERSION}*`

SeaTunnel Version

2.1.0

SeaTunnel Config

env {
    execution.parallelism = 1
}

source {
    JdbcSource {
        driver = com.mysql.jdbc.Driver
        url = "My Database Address"
        username = "My Database Username"
        password = "My Database Password"
        query = "select column1, column2 from TABLE_NAME"
        result_table_name = TABLE_NAME
    }
}

transform {
    sql {
        sql = "select column1, column2 from TABLE_NAME"
    }
}

sink {
    ConsoleSink {}
}

Running Command

docker build -t seatunnel:2.1.0-flink-1.13 -f Dockerfile .
kubectl create -f https://github.com/jetstack/cert-manager/releases/download/v1.7.1/cert-manager.yaml
helm repo add flink-operator-repo https://downloads.apache.org/flink/flink-kubernetes-operator-0.1.0/
helm install flink-kubernetes-operator flink-operator-repo/flink-kubernetes-operator
kubectl get pods
mkdir -p /mnt/data
mv flink.streaming.conf /mnt/data/
kubectl apply -f seatunnel-flink.yaml
kubectl logs -f deploy/seatunnel-flink-streaming-example

Error Exception

sed: couldn't open temporary file /opt/flink/conf/sed1i8RS3: Read-only file system
sed: couldn't open temporary file /opt/flink/conf/sedsVQITo: Read-only file system
/docker-entrypoint.sh: line 73: /opt/flink/conf/flink-conf.yaml: Read-only file system
sed: couldn't open temporary file /opt/flink/conf/sedD2KtW7: Read-only file system
/docker-entrypoint.sh: line 88: /opt/flink/conf/flink-conf.yaml.tmp: Read-only file system
Starting kubernetes-application as a console application on host seatunnel-flink-streaming-example-6c5cbb8969-b8zl2.
2022-06-16 03:42:24,557 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] - --------------------------------------------------------------------------------
2022-06-16 03:42:24,559 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] -  Preconfiguration:
2022-06-16 03:42:24,559 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] -

RESOURCE_PARAMS extraction logs:
jvm_params: -Xmx1530082096 -Xms1530082096 -XX:MaxMetaspaceSize=268435456
dynamic_configs: -D jobmanager.memory.off-heap.size=134217728b -D jobmanager.memory.jvm-overhead.min=214748368b -D jobmanager.memory.jvm-metaspace.size=268435456b -D jobmanager.memory.heap.size=1530082096b -D jobmanager.memory.jvm-overhead.max=214748368b
logs: INFO  [] - Loading configuration property: blob.server.port, 6124
INFO  [] - Loading configuration property: kubernetes.jobmanager.replicas, 1
INFO  [] - Loading configuration property: jobmanager.rpc.address, seatunnel-flink-streaming-example.default
INFO  [] - Loading configuration property: kubernetes.taskmanager.cpu, 2.0
INFO  [] - Loading configuration property: kubernetes.service-account, flink
INFO  [] - Loading configuration property: kubernetes.cluster-id, seatunnel-flink-streaming-example
INFO  [] - Loading configuration property: $internal.application.program-args, --config;/data/mysql-polardb.base_station.conf
INFO  [] - Loading configuration property: kubernetes.container.image, seatunnel:2.1.0-flink-1.13
INFO  [] - Loading configuration property: parallelism.default, 2
INFO  [] - Loading configuration property: kubernetes.namespace, default
INFO  [] - Loading configuration property: taskmanager.numberOfTaskSlots, 2
INFO  [] - Loading configuration property: kubernetes.rest-service.exposed.type, ClusterIP
INFO  [] - Loading configuration property: $internal.application.main, org.apache.seatunnel.SeatunnelFlink
INFO  [] - Loading configuration property: taskmanager.memory.process.size, 2048m
INFO  [] - Loading configuration property: kubernetes.internal.jobmanager.entrypoint.class, org.apache.flink.kubernetes.entrypoint.KubernetesApplicationClusterEntrypoint
INFO  [] - Loading configuration property: kubernetes.pod-template-file, /tmp/podTemplate_9550636116110032429.yaml
INFO  [] - Loading configuration property: kubernetes.pod-template-file.taskmanager, /tmp/podTemplate_17231682581835062062.yaml
INFO  [] - Loading configuration property: execution.target, kubernetes-application
INFO  [] - Loading configuration property: jobmanager.memory.process.size, 2048m
INFO  [] - Loading configuration property: jobmanager.rpc.port, 6123
INFO  [] - Loading configuration property: taskmanager.rpc.port, 6122
INFO  [] - Loading configuration property: internal.cluster.execution-mode, NORMAL
INFO  [] - Loading configuration property: queryable-state.proxy.ports, 6125
INFO  [] - Loading configuration property: pipeline.jars, local:///opt/flink/usrlib/seatunnel-core-flink.jar
INFO  [] - Loading configuration property: kubernetes.jobmanager.cpu, 1.0
INFO  [] - Loading configuration property: kubernetes.pod-template-file.jobmanager, /tmp/podTemplate_9424114359362793158.yaml
INFO  [] - Final Master Memory configuration:
INFO  [] -   Total Process Memory: 2.000gb (2147483648 bytes)
INFO  [] -     Total Flink Memory: 1.550gb (1664299824 bytes)
INFO  [] -       JVM Heap:         1.425gb (1530082096 bytes)
INFO  [] -       Off-heap:         128.000mb (134217728 bytes)
INFO  [] -     JVM Metaspace:      256.000mb (268435456 bytes)
INFO  [] -     JVM Overhead:       204.800mb (214748368 bytes)

2022-06-16 03:42:24,559 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] - --------------------------------------------------------------------------------
2022-06-16 03:42:24,560 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] -  Starting KubernetesApplicationClusterEntrypoint (Version: 1.13.6, Scala: 2.12, Rev:b2ca390, Date:2022-02-03T14:54:22+01:00)
2022-06-16 03:42:24,560 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] -  OS current user: flink
2022-06-16 03:42:24,560 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] -  Current Hadoop/Kerberos user: <no hadoop dependency found>
2022-06-16 03:42:24,560 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] -  JVM: OpenJDK 64-Bit Server VM - Oracle Corporation - 1.8/25.332-b09
2022-06-16 03:42:24,560 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] -  Maximum heap size: 1411 MiBytes
2022-06-16 03:42:24,560 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] -  JAVA_HOME: /usr/local/openjdk-8
2022-06-16 03:42:24,560 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] -  No Hadoop Dependency available
2022-06-16 03:42:24,560 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] -  JVM Options:
2022-06-16 03:42:24,560 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] -     -Xmx1530082096
2022-06-16 03:42:24,560 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] -     -Xms1530082096
2022-06-16 03:42:24,560 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] -     -XX:MaxMetaspaceSize=268435456
2022-06-16 03:42:24,561 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] -     -Dlog.file=/opt/flink/log/flink--kubernetes-application-0-seatunnel-flink-streaming-example-6c5cbb8969-b8zl2.log
2022-06-16 03:42:24,561 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] -     -Dlog4j.configuration=file:/opt/flink/conf/log4j-console.properties
2022-06-16 03:42:24,561 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] -     -Dlog4j.configurationFile=file:/opt/flink/conf/log4j-console.properties
2022-06-16 03:42:24,561 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] -     -Dlogback.configurationFile=file:/opt/flink/conf/logback-console.xml
2022-06-16 03:42:24,561 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] -  Program Arguments:
2022-06-16 03:42:24,561 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] -     -D
2022-06-16 03:42:24,561 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] -     jobmanager.memory.off-heap.size=134217728b
2022-06-16 03:42:24,562 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] -     -D
2022-06-16 03:42:24,562 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] -     jobmanager.memory.jvm-overhead.min=214748368b
2022-06-16 03:42:24,562 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] -     -D
2022-06-16 03:42:24,562 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] -     jobmanager.memory.jvm-metaspace.size=268435456b
2022-06-16 03:42:24,562 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] -     -D
2022-06-16 03:42:24,562 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] -     jobmanager.memory.heap.size=1530082096b
2022-06-16 03:42:24,562 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] -     -D
2022-06-16 03:42:24,562 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] -     jobmanager.memory.jvm-overhead.max=214748368b
2022-06-16 03:42:24,562 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] -  Classpath: /opt/flink/lib/flink-csv-1.13.6.jar:/opt/flink/lib/flink-json-1.13.6.jar:/opt/flink/lib/flink-shaded-zookeeper-3.4.14.jar:/opt/flink/lib/flink-table-blink_2.12-1.13.6.jar:/opt/flink/lib/flink-table_2.12-1.13.6.jar:/opt/flink/lib/log4j-1.2-api-2.17.1.jar:/opt/flink/lib/log4j-api-2.17.1.jar:/opt/flink/lib/log4j-core-2.17.1.jar:/opt/flink/lib/log4j-slf4j-impl-2.17.1.jar:/opt/flink/lib/flink-dist_2.12-1.13.6.jar:::
2022-06-16 03:42:24,562 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] - --------------------------------------------------------------------------------
2022-06-16 03:42:24,563 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] - Registered UNIX signal handlers for [TERM, HUP, INT]
2022-06-16 03:42:24,571 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: blob.server.port, 6124
2022-06-16 03:42:24,571 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: kubernetes.jobmanager.replicas, 1
2022-06-16 03:42:24,571 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: jobmanager.rpc.address, seatunnel-flink-streaming-example.default
2022-06-16 03:42:24,571 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: kubernetes.taskmanager.cpu, 2.0
2022-06-16 03:42:24,571 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: kubernetes.service-account, flink
2022-06-16 03:42:24,571 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: kubernetes.cluster-id, seatunnel-flink-streaming-example
2022-06-16 03:42:24,571 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: $internal.application.program-args, --config;/data/mysql-polardb.base_station.conf
2022-06-16 03:42:24,571 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: kubernetes.container.image, seatunnel:2.1.0-flink-1.13
2022-06-16 03:42:24,571 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: parallelism.default, 2
2022-06-16 03:42:24,572 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: kubernetes.namespace, default
2022-06-16 03:42:24,572 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: taskmanager.numberOfTaskSlots, 2
2022-06-16 03:42:24,572 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: kubernetes.rest-service.exposed.type, ClusterIP
2022-06-16 03:42:24,572 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: $internal.application.main, org.apache.seatunnel.SeatunnelFlink
2022-06-16 03:42:24,572 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: taskmanager.memory.process.size, 2048m
2022-06-16 03:42:24,572 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: kubernetes.internal.jobmanager.entrypoint.class, org.apache.flink.kubernetes.entrypoint.KubernetesApplicationClusterEntrypoint
2022-06-16 03:42:24,572 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: kubernetes.pod-template-file, /tmp/podTemplate_9550636116110032429.yaml
2022-06-16 03:42:24,572 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: kubernetes.pod-template-file.taskmanager, /tmp/podTemplate_17231682581835062062.yaml
2022-06-16 03:42:24,572 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: execution.target, kubernetes-application
2022-06-16 03:42:24,573 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: jobmanager.memory.process.size, 2048m
2022-06-16 03:42:24,573 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: jobmanager.rpc.port, 6123
2022-06-16 03:42:24,573 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: taskmanager.rpc.port, 6122
2022-06-16 03:42:24,573 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: internal.cluster.execution-mode, NORMAL
2022-06-16 03:42:24,573 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: queryable-state.proxy.ports, 6125
2022-06-16 03:42:24,573 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: pipeline.jars, local:///opt/flink/usrlib/seatunnel-core-flink.jar
2022-06-16 03:42:24,573 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: kubernetes.jobmanager.cpu, 1.0
2022-06-16 03:42:24,573 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: kubernetes.pod-template-file.jobmanager, /tmp/podTemplate_9424114359362793158.yaml
2022-06-16 03:42:24,879 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] - Starting KubernetesApplicationClusterEntrypoint.
2022-06-16 03:42:24,885 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] - Install default filesystem.
2022-06-16 03:42:24,888 INFO  org.apache.flink.core.fs.FileSystem                          [] - Hadoop is not in the classpath/dependencies. The extended set of supported File Systems via Hadoop is not available.
2022-06-16 03:42:24,948 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] - Install security context.
2022-06-16 03:42:24,954 INFO  org.apache.flink.runtime.security.modules.HadoopModuleFactory [] - Cannot create Hadoop Security Module because Hadoop cannot be found in the Classpath.
2022-06-16 03:42:24,956 INFO  org.apache.flink.runtime.security.modules.JaasModule         [] - Jaas file will be created as /tmp/jaas-7841622857492996650.conf.
2022-06-16 03:42:24,959 INFO  org.apache.flink.runtime.security.contexts.HadoopSecurityContextFactory [] - Cannot install HadoopSecurityContext because Hadoop cannot be found in the Classpath.
2022-06-16 03:42:24,960 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] - Initializing cluster services.
2022-06-16 03:42:24,972 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils        [] - Trying to start actor system, external address seatunnel-flink-streaming-example.default:6123, bind address 0.0.0.0:6123.
2022-06-16 03:42:25,875 INFO  akka.event.slf4j.Slf4jLogger                                 [] - Slf4jLogger started
2022-06-16 03:42:25,939 INFO  akka.remote.Remoting                                         [] - Starting remoting
2022-06-16 03:42:26,142 INFO  akka.remote.Remoting                                         [] - Remoting started; listening on addresses :[akka.tcp://flink@seatunnel-flink-streaming-example.default:6123]
2022-06-16 03:42:26,336 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils        [] - Actor system started at akka.tcp://flink@seatunnel-flink-streaming-example.default:6123
2022-06-16 03:42:26,353 INFO  org.apache.flink.configuration.Configuration                 [] - Config uses fallback configuration key 'jobmanager.rpc.address' instead of key 'rest.address'
2022-06-16 03:42:26,360 INFO  org.apache.flink.runtime.blob.BlobServer                     [] - Created BLOB server storage directory /tmp/blobStore-57d1cab5-5fdc-42e1-91d8-90e18692e21d
2022-06-16 03:42:26,362 INFO  org.apache.flink.runtime.blob.BlobServer                     [] - Started BLOB server at 0.0.0.0:6124 - max concurrent requests: 50 - max backlog: 1000
2022-06-16 03:42:26,368 INFO  org.apache.flink.runtime.metrics.MetricRegistryImpl          [] - No metrics reporter configured, no metrics will be exposed/reported.
2022-06-16 03:42:26,370 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils        [] - Trying to start actor system, external address seatunnel-flink-streaming-example.default:0, bind address 0.0.0.0:0.
2022-06-16 03:42:26,436 INFO  akka.event.slf4j.Slf4jLogger                                 [] - Slf4jLogger started
2022-06-16 03:42:26,441 INFO  akka.remote.Remoting                                         [] - Starting remoting
2022-06-16 03:42:26,448 INFO  akka.remote.Remoting                                         [] - Remoting started; listening on addresses :[akka.tcp://flink-metrics@seatunnel-flink-streaming-example.default:44706]
2022-06-16 03:42:26,456 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils        [] - Actor system started at akka.tcp://flink-metrics@seatunnel-flink-streaming-example.default:44706
2022-06-16 03:42:26,531 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcService             [] - Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at akka://flink-metrics/user/rpc/MetricQueryService .
2022-06-16 03:42:26,646 INFO  org.apache.flink.configuration.Configuration                 [] - Config uses fallback configuration key 'jobmanager.rpc.address' instead of key 'rest.address'
2022-06-16 03:42:26,647 INFO  org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Upload directory /tmp/flink-web-cfab19b8-ae0f-40e5-a09e-7f80d7ea93a3/flink-web-upload does not exist.
2022-06-16 03:42:26,648 INFO  org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Created directory /tmp/flink-web-cfab19b8-ae0f-40e5-a09e-7f80d7ea93a3/flink-web-upload for file uploads.
2022-06-16 03:42:26,662 INFO  org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Starting rest endpoint.
2022-06-16 03:42:26,833 INFO  org.apache.flink.runtime.webmonitor.WebMonitorUtils          [] - Determined location of main cluster component log file: /opt/flink/log/flink--kubernetes-application-0-seatunnel-flink-streaming-example-6c5cbb8969-b8zl2.log
2022-06-16 03:42:26,833 INFO  org.apache.flink.runtime.webmonitor.WebMonitorUtils          [] - Determined location of main cluster component stdout file: /opt/flink/log/flink--kubernetes-application-0-seatunnel-flink-streaming-example-6c5cbb8969-b8zl2.out
2022-06-16 03:42:27,055 INFO  org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Rest endpoint listening at seatunnel-flink-streaming-example.default:8081
2022-06-16 03:42:27,056 INFO  org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - http://seatunnel-flink-streaming-example.default:8081 was granted leadership with leaderSessionID=00000000-0000-0000-0000-000000000000
2022-06-16 03:42:27,057 INFO  org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Web frontend listening at http://seatunnel-flink-streaming-example.default:8081.
2022-06-16 03:42:27,544 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: blob.server.port, 6124
2022-06-16 03:42:27,544 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: kubernetes.jobmanager.replicas, 1
2022-06-16 03:42:27,544 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: jobmanager.rpc.address, seatunnel-flink-streaming-example.default
2022-06-16 03:42:27,544 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: kubernetes.taskmanager.cpu, 2.0
2022-06-16 03:42:27,544 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: kubernetes.service-account, flink
2022-06-16 03:42:27,544 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: kubernetes.cluster-id, seatunnel-flink-streaming-example
2022-06-16 03:42:27,544 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: $internal.application.program-args, --config;/data/mysql-polardb.base_station.conf
2022-06-16 03:42:27,544 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: kubernetes.container.image, seatunnel:2.1.0-flink-1.13
2022-06-16 03:42:27,544 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: parallelism.default, 2
2022-06-16 03:42:27,544 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: kubernetes.namespace, default
2022-06-16 03:42:27,544 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: taskmanager.numberOfTaskSlots, 2
2022-06-16 03:42:27,545 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: kubernetes.rest-service.exposed.type, ClusterIP
2022-06-16 03:42:27,545 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: $internal.application.main, org.apache.seatunnel.SeatunnelFlink
2022-06-16 03:42:27,545 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: taskmanager.memory.process.size, 2048m
2022-06-16 03:42:27,545 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: kubernetes.internal.jobmanager.entrypoint.class, org.apache.flink.kubernetes.entrypoint.KubernetesApplicationClusterEntrypoint
2022-06-16 03:42:27,545 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: kubernetes.pod-template-file, /tmp/podTemplate_9550636116110032429.yaml
2022-06-16 03:42:27,545 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: kubernetes.pod-template-file.taskmanager, /tmp/podTemplate_17231682581835062062.yaml
2022-06-16 03:42:27,545 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: execution.target, kubernetes-application
2022-06-16 03:42:27,545 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: jobmanager.memory.process.size, 2048m
2022-06-16 03:42:27,545 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: jobmanager.rpc.port, 6123
2022-06-16 03:42:27,545 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: taskmanager.rpc.port, 6122
2022-06-16 03:42:27,545 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: internal.cluster.execution-mode, NORMAL
2022-06-16 03:42:27,545 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: queryable-state.proxy.ports, 6125
2022-06-16 03:42:27,545 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: pipeline.jars, local:///opt/flink/usrlib/seatunnel-core-flink.jar
2022-06-16 03:42:27,545 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: kubernetes.jobmanager.cpu, 1.0
2022-06-16 03:42:27,545 INFO  org.apache.flink.configuration.GlobalConfiguration           [] - Loading configuration property: kubernetes.pod-template-file.jobmanager, /tmp/podTemplate_9424114359362793158.yaml
2022-06-16 03:42:27,549 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcService             [] - Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager at akka://flink/user/rpc/resourcemanager_0 .
2022-06-16 03:42:27,562 INFO  org.apache.flink.runtime.dispatcher.runner.DefaultDispatcherRunner [] - DefaultDispatcherRunner was granted leadership with leader id 00000000-0000-0000-0000-000000000000. Creating new DispatcherLeaderProcess.
2022-06-16 03:42:27,565 INFO  org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] - Start SessionDispatcherLeaderProcess.
2022-06-16 03:42:27,630 INFO  org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] - Recover all persisted job graphs.
2022-06-16 03:42:27,630 INFO  org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] - Successfully recovered 0 persisted job graphs.
2022-06-16 03:42:27,632 INFO  org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Starting the resource manager.
2022-06-16 03:42:27,638 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcService             [] - Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at akka://flink/user/rpc/dispatcher_1 .
2022-06-16 03:42:27,651 INFO  org.apache.flink.client.ClientUtils                          [] - Starting program (detached: true)
2022-06-16 03:42:27,758 INFO  org.apache.seatunnel.config.ConfigBuilder                    [] - Loading config file: /data/mysql-polardb.base_station.conf
2022-06-16 03:42:27,856 INFO  org.apache.seatunnel.config.ConfigBuilder                    [] - parsed config file: {
    "env" : {
        "execution.parallelism" : 1
    },
    "sink" : [
        {
            "plugin_name" : "ConsoleSink"
        }
    ],
    "source" : [
        {
            "driver" : "com.mysql.jdbc.Driver",
            "password" : "My Database Password",
            "plugin_name" : "JdbcSource",
            "query" : "select column1, column2 from TABLE_NAME",
            "result_table_name" : "TABLE_NAME",
            "url" : "My Database Address",
            "username" : "My Database Username"
        }
    ],
    "transform" : [
        {
            "plugin_name" : "sql",
            "sql" : "select column1, column2 from TABLE_NAME"
        }
    ]
}

2022-06-16 03:42:28,629 WARN  org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap [] - Application failed unexpectedly:
java.util.concurrent.CompletionException: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application.
        at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292) ~[?:1.8.0_332]
        at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308) ~[?:1.8.0_332]
        at java.util.concurrent.CompletableFuture.uniCompose(CompletableFuture.java:957) ~[?:1.8.0_332]
        at java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:940) ~[?:1.8.0_332]
        at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) ~[?:1.8.0_332]
        at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) ~[?:1.8.0_332]
        at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:257) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
        at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.lambda$runApplicationAsync$1(ApplicationDispatcherBootstrap.java:212) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_332]
        at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_332]
        at org.apache.flink.runtime.concurrent.akka.ActorSystemScheduledExecutorAdapter$ScheduledFutureTask.run(ActorSystemScheduledExecutorAdapter.java:159) [flink-dist_2.12-1.13.6.jar:1.13.6]
        at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:40) [flink-dist_2.12-1.13.6.jar:1.13.6]
        at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:44) [flink-dist_2.12-1.13.6.jar:1.13.6]
        at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) [flink-dist_2.12-1.13.6.jar:1.13.6]
        at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) [flink-dist_2.12-1.13.6.jar:1.13.6]
        at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) [flink-dist_2.12-1.13.6.jar:1.13.6]
        at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) [flink-dist_2.12-1.13.6.jar:1.13.6]
Caused by: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application.
        ... 11 more
Caused by: java.lang.NoClassDefFoundError: org/apache/flink/connector/jdbc/JdbcInputFormat
        at org.apache.seatunnel.flink.source.JdbcSource.prepare(JdbcSource.java:163) ~[?:?]
        at org.apache.seatunnel.flink.source.JdbcSource.prepare(JdbcSource.java:60) ~[?:?]
        at org.apache.seatunnel.Seatunnel.lambda$prepare$0(Seatunnel.java:160) ~[?:?]
        at java.util.ArrayList.forEach(ArrayList.java:1259) ~[?:1.8.0_332]
        at org.apache.seatunnel.Seatunnel.prepare(Seatunnel.java:160) ~[?:?]
        at org.apache.seatunnel.Seatunnel.entryPoint(Seatunnel.java:104) ~[?:?]
        at org.apache.seatunnel.Seatunnel.run(Seatunnel.java:65) ~[?:?]
        at org.apache.seatunnel.SeatunnelFlink.main(SeatunnelFlink.java:29) ~[?:?]
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_332]
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_332]
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_332]
        at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_332]
        at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
        at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
        at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
        at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:242) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
        ... 10 more
Caused by: java.lang.ClassNotFoundException: org.apache.flink.connector.jdbc.JdbcInputFormat
        at java.net.URLClassLoader.findClass(URLClassLoader.java:387) ~[?:1.8.0_332]
        at java.lang.ClassLoader.loadClass(ClassLoader.java:418) ~[?:1.8.0_332]
        at org.apache.flink.util.FlinkUserCodeClassLoader.loadClassWithoutExceptionHandling(FlinkUserCodeClassLoader.java:64) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
        at org.apache.flink.util.ChildFirstClassLoader.loadClassWithoutExceptionHandling(ChildFirstClassLoader.java:65) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
        at org.apache.flink.util.FlinkUserCodeClassLoader.loadClass(FlinkUserCodeClassLoader.java:48) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
        at java.lang.ClassLoader.loadClass(ClassLoader.java:351) ~[?:1.8.0_332]
        at org.apache.seatunnel.flink.source.JdbcSource.prepare(JdbcSource.java:163) ~[?:?]
        at org.apache.seatunnel.flink.source.JdbcSource.prepare(JdbcSource.java:60) ~[?:?]
        at org.apache.seatunnel.Seatunnel.lambda$prepare$0(Seatunnel.java:160) ~[?:?]
        at java.util.ArrayList.forEach(ArrayList.java:1259) ~[?:1.8.0_332]
        at org.apache.seatunnel.Seatunnel.prepare(Seatunnel.java:160) ~[?:?]
        at org.apache.seatunnel.Seatunnel.entryPoint(Seatunnel.java:104) ~[?:?]
        at org.apache.seatunnel.Seatunnel.run(Seatunnel.java:65) ~[?:?]
        at org.apache.seatunnel.SeatunnelFlink.main(SeatunnelFlink.java:29) ~[?:?]
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_332]
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_332]
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_332]
        at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_332]
        at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
        at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
        at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
        at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:242) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
        ... 10 more
2022-06-16 03:42:28,641 ERROR org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] - Fatal error occurred in the cluster entrypoint.
org.apache.flink.util.FlinkException: Application failed unexpectedly.
        at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.lambda$runApplicationAndShutdownClusterAsync$0(ApplicationDispatcherBootstrap.java:170) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
        at java.util.concurrent.CompletableFuture.uniHandle(CompletableFuture.java:836) ~[?:1.8.0_332]
        at java.util.concurrent.CompletableFuture$UniHandle.tryFire(CompletableFuture.java:811) ~[?:1.8.0_332]
        at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) ~[?:1.8.0_332]
        at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) ~[?:1.8.0_332]
        at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:257) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
        at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.lambda$runApplicationAsync$1(ApplicationDispatcherBootstrap.java:212) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_332]
        at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_332]
        at org.apache.flink.runtime.concurrent.akka.ActorSystemScheduledExecutorAdapter$ScheduledFutureTask.run(ActorSystemScheduledExecutorAdapter.java:159) [flink-dist_2.12-1.13.6.jar:1.13.6]
        at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:40) [flink-dist_2.12-1.13.6.jar:1.13.6]
        at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:44) [flink-dist_2.12-1.13.6.jar:1.13.6]
        at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) [flink-dist_2.12-1.13.6.jar:1.13.6]
        at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) [flink-dist_2.12-1.13.6.jar:1.13.6]
        at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) [flink-dist_2.12-1.13.6.jar:1.13.6]
        at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) [flink-dist_2.12-1.13.6.jar:1.13.6]
Caused by: java.util.concurrent.CompletionException: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application.
        at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292) ~[?:1.8.0_332]
        at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308) ~[?:1.8.0_332]
        at java.util.concurrent.CompletableFuture.uniCompose(CompletableFuture.java:957) ~[?:1.8.0_332]
        at java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:940) ~[?:1.8.0_332]
        ... 13 more
Caused by: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application.
        ... 11 more
Caused by: java.lang.NoClassDefFoundError: org/apache/flink/connector/jdbc/JdbcInputFormat
        at org.apache.seatunnel.flink.source.JdbcSource.prepare(JdbcSource.java:163) ~[?:?]
        at org.apache.seatunnel.flink.source.JdbcSource.prepare(JdbcSource.java:60) ~[?:?]
        at org.apache.seatunnel.Seatunnel.lambda$prepare$0(Seatunnel.java:160) ~[?:?]
        at java.util.ArrayList.forEach(ArrayList.java:1259) ~[?:1.8.0_332]
        at org.apache.seatunnel.Seatunnel.prepare(Seatunnel.java:160) ~[?:?]
        at org.apache.seatunnel.Seatunnel.entryPoint(Seatunnel.java:104) ~[?:?]
        at org.apache.seatunnel.Seatunnel.run(Seatunnel.java:65) ~[?:?]
        at org.apache.seatunnel.SeatunnelFlink.main(SeatunnelFlink.java:29) ~[?:?]
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_332]
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_332]
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_332]
        at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_332]
        at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
        at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
        at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
        at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:242) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
        ... 10 more
Caused by: java.lang.ClassNotFoundException: org.apache.flink.connector.jdbc.JdbcInputFormat
        at java.net.URLClassLoader.findClass(URLClassLoader.java:387) ~[?:1.8.0_332]
        at java.lang.ClassLoader.loadClass(ClassLoader.java:418) ~[?:1.8.0_332]
        at org.apache.flink.util.FlinkUserCodeClassLoader.loadClassWithoutExceptionHandling(FlinkUserCodeClassLoader.java:64) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
        at org.apache.flink.util.ChildFirstClassLoader.loadClassWithoutExceptionHandling(ChildFirstClassLoader.java:65) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
        at org.apache.flink.util.FlinkUserCodeClassLoader.loadClass(FlinkUserCodeClassLoader.java:48) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
        at java.lang.ClassLoader.loadClass(ClassLoader.java:351) ~[?:1.8.0_332]
        at org.apache.seatunnel.flink.source.JdbcSource.prepare(JdbcSource.java:163) ~[?:?]
        at org.apache.seatunnel.flink.source.JdbcSource.prepare(JdbcSource.java:60) ~[?:?]
        at org.apache.seatunnel.Seatunnel.lambda$prepare$0(Seatunnel.java:160) ~[?:?]
        at java.util.ArrayList.forEach(ArrayList.java:1259) ~[?:1.8.0_332]
        at org.apache.seatunnel.Seatunnel.prepare(Seatunnel.java:160) ~[?:?]
        at org.apache.seatunnel.Seatunnel.entryPoint(Seatunnel.java:104) ~[?:?]
        at org.apache.seatunnel.Seatunnel.run(Seatunnel.java:65) ~[?:?]
        at org.apache.seatunnel.SeatunnelFlink.main(SeatunnelFlink.java:29) ~[?:?]
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_332]
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_332]
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_332]
        at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_332]
        at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
        at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
        at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
        at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:242) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
        ... 10 more
2022-06-16 03:42:29,651 INFO  akka.remote.RemoteActorRefProvider$RemotingTerminator        [] - Shutting down remote daemon.
2022-06-16 03:42:29,653 INFO  akka.remote.RemoteActorRefProvider$RemotingTerminator        [] - Remote daemon shut down; proceeding with flushing remote transports.
2022-06-16 03:42:29,654 INFO  akka.remote.RemoteActorRefProvider$RemotingTerminator        [] - Shutting down remote daemon.
2022-06-16 03:42:29,655 INFO  akka.remote.RemoteActorRefProvider$RemotingTerminator        [] - Remote daemon shut down; proceeding with flushing remote transports.
2022-06-16 03:42:29,735 INFO  akka.remote.RemoteActorRefProvider$RemotingTerminator        [] - Remoting shut down.
2022-06-16 03:42:29,736 INFO  akka.remote.RemoteActorRefProvider$RemotingTerminator        [] - Remoting shut down.

Flink or Spark Version

Flink version：1.13

Java or Scala Version

No response

Screenshots

No response

Are you willing to submit PR?

Code of Conduct

ashulin commented 2 years ago

'seatunnel-core-flink' isn't contains the Jdbc connector jar. You can refer to the link: https://seatunnel.apache.org/docs/2.1.0/flink/quick-start

ChenpiDog commented 2 years ago

@ashulin What is the missing dependency? I put MySQL JDBC (mysql-connector-java-8.0.17.jar) into $FLINK_HOME/usrlib/, still not.

ChenpiDog commented 2 years ago

@ashulin What is the missing dependency? I put MySQL JDBC (mysql-connector-java-8.0.17.jar) into $FLINK_HOME/usrlib/, still not.

$FLINK_HOME/lib/, still not

ChenpiDog commented 2 years ago

Add dependency: flink-connector-jdbc_2.11-1.11.6.jar, solve the problem

Hisoka-X commented 2 years ago

Close by resolved

h472591847 commented 2 years ago

Excuse me, how can I add dependencies: flink-connector-jdbc_xxxx in kubernetes

ChenpiDog commented 2 years ago

Excuse me, how can I add dependencies: flink-connector-jdbc_xxxx in kubernetes

@h472591847 Sorry, have you solved it now? The following is my docker file for reference.

FROM flink:1.13.6

ENV SEATUNNEL_VERSION="2.1.0"

RUN wget https://archive.apache.org/dist/incubator/seatunnel/${SEATUNNEL_VERSION}/apache-seatunnel-incubating-${SEATUNNEL_VERSION}-bin.tar.gz RUN tar -xzvf apache-seatunnel-incubating-${SEATUNNEL_VERSION}-bin.tar.gz

RUN mkdir -p $FLINK_HOME/usrlib RUN cp apache-seatunnel-incubating-${SEATUNNEL_VERSION}/lib/seatunnel-core-flink.jar $FLINK_HOME/usrlib/seatunnel-core-flink.jar ADD ./flink-connector-jdbc_2.11-1.13.6.jar $FLINK_HOME/lib/ ADD ./mysql-connector-java-8.0.17.jar $FLINK_HOME/lib/

RUN rm -fr apache-seatunnel-incubating-${SEATUNNEL_VERSION}*