nchammas / flintrock

A command-line tool for launching Apache Spark clusters.
Apache License 2.0
637 stars 116 forks source link

Add support for HDFS 3.x+ #306

Closed sfcoy closed 4 years ago

sfcoy commented 4 years ago

Flintrock works great with the new 3.0 Apache Spark releases.

Unfortunately we cannot bring along Hadoop 3.x because they have changed many of their standard TCP port numbers. See Default ports of multiple services have been changed.

From the Flintrock perspective, port 9870 must be used in place of port 50070.