Run on AWS

[ErnstTmp]

Hi Hardmaru, we would be interested to run ES-Tool (Thanks for creating it!!) on a cluster of machines on AWS. Would you be interested in a pull request, if we implement this, and would it be OK for you if we use Star Cluster (http://star.mit.edu/cluster/index.html) as a cluster management tool?

Thanks & kind regards Ernst

[hardmaru]

Hi Ernst,

I prefer not to be tied to a particular company's cloud infrastructure. Would it be possible to write it in such a way so that it is independent of AWS or GCP (say using only the MPI framework)?

The AWS-dependent code can hopefully sit somewhere else.

If this is not possible, feel free to implement a forked implementation of the AWS cluster machine version. Would love to see how you did it in the future.

Thanks and Regards.

[MaxwellRebo]

@ErnstTmp just make a docker image or something. I agree with @hardmaru that the tool itself should remain pure, and free of specific opinions on infrastructure or tools (outside of what is needed to make it function, such as numpy).

[ErnstTmp]

Hi, thanks, I agree, it makes sense to make it agnostic of cloud service provider. I will use mpirun first and will create a pull request as soon as I have something.

[hardmaru]

Thanks, looking forward to seeing it work on multiple machines-

On Thu, Nov 16, 2017 at 2:23 PM ErnstTmp notifications@github.com wrote:

Hi, thanks, I agree, it makes sense to make it agnostic of cloud service provider. I will use mpirun first and will create a pull request as soon as I have something.

— You are receiving this because you were mentioned.

Reply to this email directly, view it on GitHub https://github.com/hardmaru/estool/issues/2#issuecomment-345082162, or mute the thread https://github.com/notifications/unsubscribe-auth/AGBoHqS8SdOlOxihZ9Tj3IinypRXK3fPks5s3LXJgaJpZM4QfnVq .