DTStack / flinkStreamSQL

基于开源的flink,对其实时sql进行扩展;主要实现了流与维表的join,支持原生flink SQL所有的语法
Apache License 2.0
2.02k stars 922 forks source link

提交任务至yarn session时,flink管理界面没有可运行的任务 #257

Open lijianfeng6666526 opened 4 years ago

lijianfeng6666526 commented 4 years ago

我的提交命令是: sh submit.sh -sql /home/sideSql4.txt -name ff -remoteSqlPluginPath /home/flinkStreamSQL-1.8.0_release/flinkStreamSQL-1.8.0_release/plugins -localSqlPluginPath /home/flinkStreamSQL-1.8.0_release/flinkStreamSQL-1.8.0_release/plugins -mode yarn -yarnconf /opt/cloudera/parcels/CDH/etc/hadoop/conf.dist -flinkconf /home/flink-1.8.0/conf -confProp {\"time.characteristic\":\"EventTime\",\"sql.checkpoint.interval\":10000} -yarnSessionConf {\"yid\":\"application_1579007643767_0009\"}

查看nohup.out时,显示一下信息: SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder". SLF4J: Defaulting to no-operation (NOP) logger implementation SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details. log4j:WARN No appenders could be found for logger (org.apache.hadoop.util.Shell). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. confProp={"time.characteristic":"EventTime","sql.checkpoint.interval":10000} applicationId=application_1579007643767_0009

yarn-session任务如下: image

flink管理界面没有可运行任务: image

todd5167 commented 4 years ago

@lijianfeng6666526 yarnsession模式测试的比较少,你先用perjob模式试下

skyhtf commented 3 years ago

@lijianfeng6666526 yarnsession模式测试的比较少,你先用perjob模式试下

我是perjob模式启动的,flink管理界面也没有,而且yarn里面看不到日志,是需要改什么吗