安装spark - Githubissues

liangguohun / HadoopSpark

Haddoop and Spark config

Apache License 2.0

0 stars 0 forks source link

Open liangguohun opened 7 years ago

liangguohun commented 7 years ago

解压缩spark包 tar zxf spark-1.4.0-bin-hadoop2.6.tgz 移动到安装目录 sudo mv spark-1.4.0-bin-hadoop2.6 /usr/local/spark 配置spark环境变量 sudo gedit ~/.bashrc

export SPARK_HOME=/usr/local/spark export PATH=$PATH:$SPARK_HOME/bin

liangguohun commented 7 years ago

修改log4j配置不要显示那么多信息 cd /usr/local/spark/conf/ cp log4j.properties.template log4j.properties sudo gedit log4j.properties 把INFO级别改为ERROR

liangguohun commented 7 years ago

安装开发工具 tar -xzvf scala-SDK-4.5.0-vfinal-2.11-linux.gtk.x86_64.tar.gz 这个以上的版本要1.8jdk