Updated to Spark 2.1.0

[pondpaun7z]

You and try with docker pull bananacoding/spark_hadoop

spark-shell

spark-submit

[Arnold1]

@pondpaun7z thanks for the nice example!

a few questions:

• does this run with yarn as a cluster manager?
• how can you use it with --deploy-mode cluster? (In yarn-cluster mode, the Spark driver runs inside an application master process which is managed by YARN on the cluster, and the client can go away after initiating the application)
• how could you deploy this to kubernetes?

here my log: https://ideone.com/dnuqX9 any idea about line 12? chown: missing operand after `/usr/local/hadoop/logs' why does it not print pi when i use --deploy-mode cluster (see line 211-277)? it works fine for --deploy-mode client: see line 166