utdemir / distributed-dataset

A distributed data processing framework in Haskell.
BSD 3-Clause "New" or "Revised" License
114 stars 5 forks source link

Kubernetes backend #29

Open utdemir opened 4 years ago

utdemir commented 4 years ago

k8s seems to be everywhere, and many major cloud providers support it.

We can simply package the binary as a Docker container (with an added advantage that it doesn't require compiling statically), and submit the Kubernetes. However kubernetes does not have a mechanism for data storage/transfers, so we might also have to deploy a distributed data store too.