nchammas / flintrock

A command-line tool for launching Apache Spark clusters.
Apache License 2.0
636 stars 116 forks source link

Ignore tiny devices #259

Closed nchammas closed 6 years ago

nchammas commented 6 years ago

This PR updates Flintrock to ignore tiny devices that are attached to some instances, like the m5 series on EC2. Previously, these devices were being picked up by Flintrock and configured as ephemeral storage, which is problematic since they have no room for anything.

I tested this PR with m5.large instances and confirmed that a) the tiny device was ignored, and b) HDFS started up successfully.

Fixes #256.