search

dev-moonduck / docker-hadoop-spawningpool

Fully distributed local Hadoop cluster on Docker generator
3 stars 2 forks source link

Error: Could not find or load main class org.apache.hadoop.yarn.server.applicationhistoryservice.ApplicationHistoryServer #8

Open dev-moonduck opened 3 years ago

dev-moonduck commented 3 years ago

When run yarn history server, I see this, but it works if I manually run /scripts/run_yarn_hs.sh

Error: Could not find or load main class org.apache.hadoop.yarn.server.applicationhistoryservice.ApplicationHistoryServer
dev-moonduck commented 3 years ago

After drilldown, something wrong found. yarn classpath is wrong, need to fix yarn-site.xml


- /etc/hadoop:/opt/hadoop/share/hadoop/common/lib/*:/opt/hadoop/share/hadoop/common/*:/opt/hadoop/share/hadoop/hdfs:/opt/hadoop/share/hadoop/hdfs/lib/*:/opt/hadoop/share/hadoop/hdfs/*:/opt/hadoop/share/hadoop/mapreduce/*:/opt/hadoop/share/hadoop/yarn:/opt/hadoop/share/hadoop/yarn/lib/*:/opt/hadoop/share/hadoop/yarn/*
+ /opt/hadoop/etc/hadoop:/opt/hadoop/share/hadoop/common/lib/*:/opt/hadoop/share/hadoop/common/*:/opt/hadoop/share/hadoop/hdfs:/opt/hadoop/share/hadoop/hdfs/lib/*:/opt/hadoop/share/hadoop/hdfs/*:/opt/hadoop/share/hadoop/mapreduce/*:/opt/hadoop/share/hadoop/yarn:/opt/hadoop/share/hadoop/yarn/lib/*:/opt/hadoop/share/hadoop/yarn/*