<configuration>
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
<!--Deploy Hadoop on K8s, we need to specify a certain port range and expose by k8s Service-->
<property>
<name>yarn.app.mapreduce.am.job.client.port-range</name>
<value>60000-60010</value>
</property>
<property>
<name>yarn.app.mapreduce.am.webapp.port-range</name>
<value>60011-60020</value>
</property>
<property>
<name>mapreduce.application.classpath</name>
<value>$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*</value>
</property>
<!--
<property>
<name>mapreduce.map.output.compress</name>
<value>true</value>
</property>
<property>
<name>mapreduce.map.output.compress.codec</name>
<value>org.apache.hadoop.io.compress.ZStandardCodec</value>
</property>
-->
</configuration>
date: 2020-08-15
ARM上搭建Hadoop Yarn的指导。
安装依赖
新增Hadoop用户
下载
环境变量准备
配置添加 cd $HADOOP_HOME/etc/hadoop/ core-site.xml
hdfs-site.xml
mapred-site.xml
yarn-site.xml
启动服务 先格式化hdfs
启动所有服务