search

cetic / helm-fadi

Helm Chart for FADI
https://github.com/cetic/fadi
Apache License 2.0
13 stars 4 forks source link

Standalone Spark - better Kubernetes integration #25

Open banzo opened 4 years ago

banzo commented 4 years ago

New versions of Spark have better Kubernetes integration: https://kubernetes.io/blog/2018/03/apache-spark-23-with-native-kubernetes/

This sample chart provides some information on the deeper integration, but also highlights possible limitations, this need to be studied a bit deeper.

Thanks to @terence-bigtt for the heads up.

banzo commented 3 years ago

We might want to implement this as an operator: https://github.com/GoogleCloudPlatform/spark-on-k8s-operator