sunshanggege
commented
9 months ago Solution: Restart StreamPark. 解决办法：重启streampark
Open sunshanggege opened 9 months ago
sunshanggege
commented
9 months ago Solution: Restart StreamPark. 解决办法：重启streampark
Search before asking
Java Version
java 9
Scala Version
2.11.x
StreamPark Version
apache-streampark_2.11-2.0.0-incubating-bin.tar.gz
Flink Version
1.14.6
deploy mode
remote
What happened
When I shut down a Flink cluster, the running Flink programs are automatically shut down, but StreamPark still shows that the running programs have not decreased. Then, when I kill a program that has already been shut down but is still shown as running in StreamPark, I can only use force kill instead of regular kill. When I start a new Flink program, it keeps showing "starting" in StreamPark instead of "running". At this point, StreamPark shows over 30 programs as running, but they have actually been shut down. When I manually force kill one of them, the StreamPark web page cannot be refreshed. Checking the error messages of StreamPark program, the following error is continuously outputted: 2023-09-20 00:00:00.880 StreamPark [scheduling-1] ERROR o.s.s.s.TaskUtils$LoggingErrorHandler:95 - Unexpected error occurred in scheduled task java.util.concurrent.RejectedExecutionException: Task org.apache.streampark.console.core.task.FlinkRESTAPIWatcher$$Lambda$1483/1866074866@122c9efd rejected from java.util.concurrent.ThreadPoolExecutor@695c721e[Running, pool size = 80, active threads = 80, queued tasks = 1024, completed tasks = 262035972] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at org.apache.streampark.console.core.task.FlinkRESTAPIWatcher.doWatch(FlinkRESTAPIWatcher.java:199) at org.apache.streampark.console.core.task.FlinkRESTAPIWatcher.start(FlinkRESTAPIWatcher.java:185) at sun.reflect.GeneratedMethodAccessor433.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)
Solution: Restart StreamPark.
中文： 当我关闭一个flink集群，其中正在运行的flink程序会自动关闭，但是streampark显示正在运行的程序没有减少； 然后我Kill掉已经关闭但是还在显示running的程序，只能使用force kill，而不能使用普通的Kill。 当我启动新的flink程序，在streampark中一直显示starting，而不能显示running。 此时streampark中有超过30多个程序显示running，但是实际上已经是关闭的程序，我手动force kill其中一个，streampark的网页就不能刷新出来了。 检查streampark程序的报错，一直输出如下报错： 2023-09-20 00:00:00.880 StreamPark [scheduling-1] ERROR o.s.s.s.TaskUtils$LoggingErrorHandler:95 - Unexpected error occurred in scheduled task java.util.concurrent.RejectedExecutionException: Task org.apache.streampark.console.core.task.FlinkRESTAPIWatcher$$Lambda$1483/1866074866@122c9efd rejected from java.util.concurrent.ThreadPoolExecutor@695c721e[Running, pool size = 80, active threads = 80, queued tasks = 1024, completed tasks = 262035972] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at org.apache.streampark.console.core.task.FlinkRESTAPIWatcher.doWatch(FlinkRESTAPIWatcher.java:199) at org.apache.streampark.console.core.task.FlinkRESTAPIWatcher.start(FlinkRESTAPIWatcher.java:185) at sun.reflect.GeneratedMethodAccessor433.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)
解决办法：重启streampark
Error Exception
Screenshots
No response
Are you willing to submit PR?
Code of Conduct