liangguohun / HadoopSpark

Haddoop and Spark config
Apache License 2.0
0 stars 0 forks source link

spark源码环境 #13

Open liangguohun opened 7 years ago

liangguohun commented 7 years ago

官网下载 tar zxvf spark-2.1.0.tgz -C ~/

文件导入现有maven项目 mvn eclipse:eclipse(生成 .classpath 和 .project 让eclipse识别目录结构) 项目上右键->MVN->Update Project 项目上右键->sacal -> add scala nature(如不识别,添加scala特性) src/main/scala 右键-> Build Path ->Use As Source Folder

build/mvn -Pyarn -Phadoop-2.6 -Dhadoop.version=2.6.0 -DskipTests clean package (hadoop 跨平台版本不兼容指定)

运行spark-shell