Docker image and cluster deployment

rajasekarv / vega

A new arguably faster implementation of Apache Spark from scratch in Rust

Apache License 2.0

2.23k stars 206 forks source link

Docker image and cluster deployment #37

Closed iduartgomez closed 4 years ago

iduartgomez commented 4 years ago

This allows to run examples and deploy a testing cluster to test/try distributed mode in a fairly automated way and should be okay to use as a template to modify as necessary (for example when we have a moire mature cluster management/deployment).

There still is some work to be done re. setting SSH (for now is manual) to use but otherwise is possible to use it to run examples in distributed mode.

rajasekarv commented 4 years ago

Very much needed PR. Thanks @iduartgomez.