feature: add configurable master instance settings

nchammas / flintrock

A command-line tool for launching Apache Spark clusters.

Apache License 2.0

636 stars 116 forks source link

feature: add configurable master instance settings #335

Open luhhujbb opened 3 years ago

luhhujbb commented 3 years ago

This PR makes the following changes:

add custom master configuration/slave only spot

Fully tested on our production environment

Fixes #82.

devyn commented 1 year ago

@nchammas can this be merged in some form? it would be nice to have this feature - depending on the application, the master doesn't really need to be very beefy, but having bigger slaves can be better for performance (to a certain extent)

nchammas commented 1 year ago

My apologies to both @luhhujbb and @devyn about leaving this PR hanging. I won't have the capacity in the foreseeable future to review and shepherd this PR through to completion.

I would consider running a fork of Flintrock to get this feature. The instructions in the README should help you build your own version. If you have trouble doing that, please reach out and I will try to help.