search

DataLinkDC / dinky

Dinky is a real-time data development platform based on Apache Flink, enabling agile data development, deployment and operation.
http://www.dinky.org.cn
Apache License 2.0
3.08k stars 1.13k forks source link

[Bug] [executor jar] Using executjar to execute doris to synchronize mysql table failed #3827

Open sprybee opened 1 week ago

sprybee commented 1 week ago

Search before asking

What happened

使用executjar执行doris同步mysql表失败 这是我的执行命令

EXECUTE JAR WITH (
'uri'='rs:/rdb_2_doris/flink-doris-connector-1.16-1.6.1.jar',
'main-class'='org.apache.doris.flink.tools.cdc.CdcTools',
'args'='mysql-sync-database --database dcmsdb  --mysql-conf hostname=xxxx  --mysql-conf port=3306  --mysql-conf username=xxxx  --mysql-conf password=xxxx  --mysql-conf database-name= --including-tables ""  --sink-conf fenodes=xxxxx  --sink-conf username=xxxx   --sink-conf password=xxxx     --sink-conf jdbc-url=xxxxx  --sink-conf sink.label-prefix=label7272 --table-conf replication_num=2'
);

What you expected to happen

java.util.concurrent.CompletionException: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application.
    at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292) ~[?:1.8.0_382]
    at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308) ~[?:1.8.0_382]
    at java.util.concurrent.CompletableFuture.uniCompose(CompletableFuture.java:957) ~[?:1.8.0_382]
    at java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:940) ~[?:1.8.0_382]
    at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) ~[?:1.8.0_382]
    at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) ~[?:1.8.0_382]
    at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:337) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.lambda$runApplicationAsync$2(ApplicationDispatcherBootstrap.java:254) ~[flink-dist-1.16.1.jar:1.16.1]
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_382]
    at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_382]
    at org.apache.flink.runtime.concurrent.akka.ActorSystemScheduledExecutorAdapter$ScheduledFutureTask.run(ActorSystemScheduledExecutorAdapter.java:171) ~[flink-rpc-akka_db92178b-0741-4f35-a4f6-329e9c15cef7.jar:1.16.1]
    at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68) ~[flink-rpc-akka_db92178b-0741-4f35-a4f6-329e9c15cef7.jar:1.16.1]
    at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.lambda$withContextClassLoader$0(ClassLoadingUtils.java:41) ~[flink-rpc-akka_db92178b-0741-4f35-a4f6-329e9c15cef7.jar:1.16.1]
    at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:49) [flink-rpc-akka_db92178b-0741-4f35-a4f6-329e9c15cef7.jar:1.16.1]
    at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:48) [flink-rpc-akka_db92178b-0741-4f35-a4f6-329e9c15cef7.jar:1.16.1]
    at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) [?:1.8.0_382]
    at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056) [?:1.8.0_382]
    at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692) [?:1.8.0_382]
    at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) [?:1.8.0_382]
Caused by: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application.
    ... 13 more
Caused by: org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: java.lang.RuntimeException: java.lang.RuntimeException: cn.hutool.core.io.IORuntimeException: ConnectException: Connection timed out (Connection timed out)
    at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:372) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:98) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:301) ~[flink-dist-1.16.1.jar:1.16.1]
    ... 12 more
Caused by: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: cn.hutool.core.io.IORuntimeException: ConnectException: Connection timed out (Connection timed out)
    at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:130) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:79) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:74) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.app.flinksql.Submitter.executeJarJob(Submitter.java:256) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.app.flinksql.Submitter.submit(Submitter.java:140) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.app.MainApp.main(MainApp.java:53) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_382]
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_382]
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_382]
    at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_382]
    at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:98) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:301) ~[flink-dist-1.16.1.jar:1.16.1]
    ... 12 more
Caused by: java.lang.RuntimeException: java.lang.RuntimeException: cn.hutool.core.io.IORuntimeException: ConnectException: Connection timed out (Connection timed out)
    at org.dinky.utils.URLUtils.toFile(URLUtils.java:63) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at cn.hutool.core.lang.Opt.map(Opt.java:279) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:92) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:79) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:74) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.app.flinksql.Submitter.executeJarJob(Submitter.java:256) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.app.flinksql.Submitter.submit(Submitter.java:140) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.app.MainApp.main(MainApp.java:53) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_382]
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_382]
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_382]
    at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_382]
    at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:98) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:301) ~[flink-dist-1.16.1.jar:1.16.1]
    ... 12 more
Caused by: java.lang.RuntimeException: cn.hutool.core.io.IORuntimeException: ConnectException: Connection timed out (Connection timed out)
    at org.dinky.resource.impl.LocalResourceManager.readFile(LocalResourceManager.java:138) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.url.RsURLConnection.connect(RsURLConnection.java:38) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.url.RsURLConnection.getInputStream(RsURLConnection.java:43) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.utils.URLUtils.toFile(URLUtils.java:56) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at cn.hutool.core.lang.Opt.map(Opt.java:279) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:92) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:79) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:74) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.app.flinksql.Submitter.executeJarJob(Submitter.java:256) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.app.flinksql.Submitter.submit(Submitter.java:140) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.app.MainApp.main(MainApp.java:53) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_382]
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_382]
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_382]
    at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_382]
    at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:98) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:301) ~[flink-dist-1.16.1.jar:1.16.1]
    ... 12 more
Caused by: cn.hutool.core.io.IORuntimeException: ConnectException: Connection timed out (Connection timed out)
    at cn.hutool.http.HttpRequest.send(HttpRequest.java:1350) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at cn.hutool.http.HttpRequest.doExecute(HttpRequest.java:1188) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at cn.hutool.http.HttpRequest.execute(HttpRequest.java:1051) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at cn.hutool.http.HttpRequest.execute(HttpRequest.java:1027) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.resource.impl.LocalResourceManager.readFile(LocalResourceManager.java:135) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.url.RsURLConnection.connect(RsURLConnection.java:38) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.url.RsURLConnection.getInputStream(RsURLConnection.java:43) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.utils.URLUtils.toFile(URLUtils.java:56) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at cn.hutool.core.lang.Opt.map(Opt.java:279) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:92) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:79) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:74) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.app.flinksql.Submitter.executeJarJob(Submitter.java:256) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.app.flinksql.Submitter.submit(Submitter.java:140) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.app.MainApp.main(MainApp.java:53) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_382]
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_382]
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_382]
    at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_382]
    at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:98) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:301) ~[flink-dist-1.16.1.jar:1.16.1]
    ... 12 more
Caused by: java.net.ConnectException: Connection timed out (Connection timed out)
    at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:1.8.0_382]
    at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) ~[?:1.8.0_382]
    at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) ~[?:1.8.0_382]
    at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[?:1.8.0_382]
    at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[?:1.8.0_382]
    at java.net.Socket.connect(Socket.java:607) ~[?:1.8.0_382]
    at java.net.Socket.connect(Socket.java:556) ~[?:1.8.0_382]
    at sun.net.NetworkClient.doConnect(NetworkClient.java:180) ~[?:1.8.0_382]
    at sun.net.www.http.HttpClient.openServer(HttpClient.java:463) ~[?:1.8.0_382]
    at sun.net.www.http.HttpClient.openServer(HttpClient.java:558) ~[?:1.8.0_382]
    at sun.net.www.http.HttpClient.<init>(HttpClient.java:242) ~[?:1.8.0_382]
    at sun.net.www.http.HttpClient.New(HttpClient.java:339) ~[?:1.8.0_382]
    at sun.net.www.http.HttpClient.New(HttpClient.java:357) ~[?:1.8.0_382]
    at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1228) ~[?:1.8.0_382]
    at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1162) ~[?:1.8.0_382]
    at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1056) ~[?:1.8.0_382]
    at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:990) ~[?:1.8.0_382]
    at cn.hutool.http.HttpConnection.connect(HttpConnection.java:387) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at cn.hutool.http.HttpRequest.send(HttpRequest.java:1345) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at cn.hutool.http.HttpRequest.doExecute(HttpRequest.java:1188) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at cn.hutool.http.HttpRequest.execute(HttpRequest.java:1051) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at cn.hutool.http.HttpRequest.execute(HttpRequest.java:1027) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.resource.impl.LocalResourceManager.readFile(LocalResourceManager.java:135) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.url.RsURLConnection.connect(RsURLConnection.java:38) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.url.RsURLConnection.getInputStream(RsURLConnection.java:43) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.utils.URLUtils.toFile(URLUtils.java:56) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at cn.hutool.core.lang.Opt.map(Opt.java:279) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:92) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:79) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:74) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.app.flinksql.Submitter.executeJarJob(Submitter.java:256) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.app.flinksql.Submitter.submit(Submitter.java:140) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.app.MainApp.main(MainApp.java:53) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_382]
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_382]
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_382]
    at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_382]
    at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:98) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:301) ~[flink-dist-1.16.1.jar:1.16.1]
    ... 12 more
2024-09-23 18:25:49,473 ERROR org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] - Fatal error occurred in the cluster entrypoint.
java.util.concurrent.CompletionException: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application.
    at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292) ~[?:1.8.0_382]
    at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308) ~[?:1.8.0_382]
    at java.util.concurrent.CompletableFuture.uniCompose(CompletableFuture.java:957) ~[?:1.8.0_382]
    at java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:940) ~[?:1.8.0_382]
    at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) ~[?:1.8.0_382]
    at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) ~[?:1.8.0_382]
    at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:337) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.lambda$runApplicationAsync$2(ApplicationDispatcherBootstrap.java:254) ~[flink-dist-1.16.1.jar:1.16.1]
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_382]
    at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_382]
    at org.apache.flink.runtime.concurrent.akka.ActorSystemScheduledExecutorAdapter$ScheduledFutureTask.run(ActorSystemScheduledExecutorAdapter.java:171) ~[flink-rpc-akka_db92178b-0741-4f35-a4f6-329e9c15cef7.jar:1.16.1]
    at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68) ~[flink-rpc-akka_db92178b-0741-4f35-a4f6-329e9c15cef7.jar:1.16.1]
    at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.lambda$withContextClassLoader$0(ClassLoadingUtils.java:41) ~[flink-rpc-akka_db92178b-0741-4f35-a4f6-329e9c15cef7.jar:1.16.1]
    at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:49) [flink-rpc-akka_db92178b-0741-4f35-a4f6-329e9c15cef7.jar:1.16.1]
    at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:48) [flink-rpc-akka_db92178b-0741-4f35-a4f6-329e9c15cef7.jar:1.16.1]
    at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) [?:1.8.0_382]
    at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056) [?:1.8.0_382]
    at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692) [?:1.8.0_382]
    at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) [?:1.8.0_382]
Caused by: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application.
    ... 13 more
Caused by: org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: java.lang.RuntimeException: java.lang.RuntimeException: cn.hutool.core.io.IORuntimeException: ConnectException: Connection timed out (Connection timed out)
    at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:372) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:98) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:301) ~[flink-dist-1.16.1.jar:1.16.1]
    ... 12 more
Caused by: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: cn.hutool.core.io.IORuntimeException: ConnectException: Connection timed out (Connection timed out)
    at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:130) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:79) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:74) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.app.flinksql.Submitter.executeJarJob(Submitter.java:256) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.app.flinksql.Submitter.submit(Submitter.java:140) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.app.MainApp.main(MainApp.java:53) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_382]
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_382]
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_382]
    at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_382]
    at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:98) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:301) ~[flink-dist-1.16.1.jar:1.16.1]
    ... 12 more
Caused by: java.lang.RuntimeException: java.lang.RuntimeException: cn.hutool.core.io.IORuntimeException: ConnectException: Connection timed out (Connection timed out)
    at org.dinky.utils.URLUtils.toFile(URLUtils.java:63) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at cn.hutool.core.lang.Opt.map(Opt.java:279) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:92) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:79) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:74) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.app.flinksql.Submitter.executeJarJob(Submitter.java:256) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.app.flinksql.Submitter.submit(Submitter.java:140) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.app.MainApp.main(MainApp.java:53) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_382]
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_382]
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_382]
    at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_382]
    at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:98) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:301) ~[flink-dist-1.16.1.jar:1.16.1]
    ... 12 more
Caused by: java.lang.RuntimeException: cn.hutool.core.io.IORuntimeException: ConnectException: Connection timed out (Connection timed out)
    at org.dinky.resource.impl.LocalResourceManager.readFile(LocalResourceManager.java:138) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.url.RsURLConnection.connect(RsURLConnection.java:38) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.url.RsURLConnection.getInputStream(RsURLConnection.java:43) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.utils.URLUtils.toFile(URLUtils.java:56) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at cn.hutool.core.lang.Opt.map(Opt.java:279) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:92) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:79) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:74) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.app.flinksql.Submitter.executeJarJob(Submitter.java:256) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.app.flinksql.Submitter.submit(Submitter.java:140) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.app.MainApp.main(MainApp.java:53) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_382]
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_382]
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_382]
    at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_382]
    at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:98) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:301) ~[flink-dist-1.16.1.jar:1.16.1]
    ... 12 more
Caused by: cn.hutool.core.io.IORuntimeException: ConnectException: Connection timed out (Connection timed out)
    at cn.hutool.http.HttpRequest.send(HttpRequest.java:1350) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at cn.hutool.http.HttpRequest.doExecute(HttpRequest.java:1188) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at cn.hutool.http.HttpRequest.execute(HttpRequest.java:1051) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at cn.hutool.http.HttpRequest.execute(HttpRequest.java:1027) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.resource.impl.LocalResourceManager.readFile(LocalResourceManager.java:135) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.url.RsURLConnection.connect(RsURLConnection.java:38) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.url.RsURLConnection.getInputStream(RsURLConnection.java:43) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.utils.URLUtils.toFile(URLUtils.java:56) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at cn.hutool.core.lang.Opt.map(Opt.java:279) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:92) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:79) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:74) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.app.flinksql.Submitter.executeJarJob(Submitter.java:256) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.app.flinksql.Submitter.submit(Submitter.java:140) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.app.MainApp.main(MainApp.java:53) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_382]
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_382]
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_382]
    at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_382]
    at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:98) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:301) ~[flink-dist-1.16.1.jar:1.16.1]
    ... 12 more
Caused by: java.net.ConnectException: Connection timed out (Connection timed out)
    at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:1.8.0_382]
    at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) ~[?:1.8.0_382]
    at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) ~[?:1.8.0_382]
    at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[?:1.8.0_382]
    at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[?:1.8.0_382]
    at java.net.Socket.connect(Socket.java:607) ~[?:1.8.0_382]
    at java.net.Socket.connect(Socket.java:556) ~[?:1.8.0_382]
    at sun.net.NetworkClient.doConnect(NetworkClient.java:180) ~[?:1.8.0_382]
    at sun.net.www.http.HttpClient.openServer(HttpClient.java:463) ~[?:1.8.0_382]
    at sun.net.www.http.HttpClient.openServer(HttpClient.java:558) ~[?:1.8.0_382]
    at sun.net.www.http.HttpClient.<init>(HttpClient.java:242) ~[?:1.8.0_382]
    at sun.net.www.http.HttpClient.New(HttpClient.java:339) ~[?:1.8.0_382]
    at sun.net.www.http.HttpClient.New(HttpClient.java:357) ~[?:1.8.0_382]
    at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1228) ~[?:1.8.0_382]
    at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1162) ~[?:1.8.0_382]
    at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1056) ~[?:1.8.0_382]
    at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:990) ~[?:1.8.0_382]
    at cn.hutool.http.HttpConnection.connect(HttpConnection.java:387) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at cn.hutool.http.HttpRequest.send(HttpRequest.java:1345) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at cn.hutool.http.HttpRequest.doExecute(HttpRequest.java:1188) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at cn.hutool.http.HttpRequest.execute(HttpRequest.java:1051) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at cn.hutool.http.HttpRequest.execute(HttpRequest.java:1027) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.resource.impl.LocalResourceManager.readFile(LocalResourceManager.java:135) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.url.RsURLConnection.connect(RsURLConnection.java:38) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.url.RsURLConnection.getInputStream(RsURLConnection.java:43) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.utils.URLUtils.toFile(URLUtils.java:56) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at cn.hutool.core.lang.Opt.map(Opt.java:279) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:92) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:79) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:74) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.app.flinksql.Submitter.executeJarJob(Submitter.java:256) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.app.flinksql.Submitter.submit(Submitter.java:140) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at org.dinky.app.MainApp.main(MainApp.java:53) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_382]
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_382]
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_382]
    at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_382]
    at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:98) ~[flink-dist-1.16.1.jar:1.16.1]
    at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:301) ~[flink-dist-1.16.1.jar:1.16.1]
    ... 12 more

How to reproduce

1、安装doris 2、安装mysql 3、下载flink_doris-connecot并执行上述语句

Anything else

No response

Version

1.1.0

Are you willing to submit PR?

Code of Conduct

Zzm0809 commented 1 week ago

链接超时, 请排查 dinky 所在服务器与 yarn 各个节点的网络互通情况

sprybee commented 1 week ago

链接超时, 请排查 dinky 所在服务器与 yarn 各个节点的网络互通情况

dinky目前稳定运行20+SQL任务，和yarn链接应该没问题吧？ 上述报错用的是dinky的jar包提交，会不会有其他的问题呢？