Helm Chart to deploy Ballista on kubernetes

AdheipSingh commented 2 years ago

Is your feature request related to a problem or challenge? Please describe what you are trying to do.

Ballista has a scheduler and executor, which need pvc's.
Currently it is k8s yaml files( which are a lot to deploy ), it would be great to add a helm chart to ease out and standardise ballista deployment process on k8s.

Also is it possible to host an official docker image of ballista ?

Describe the solution you'd like As described above, helm chart would be helpful.

Describe alternatives you've considered None

Additional context None

I'd be willing to contribute to the helm chart.

andygrove commented 2 years ago

I would love to see official docker images for DataFusion/Ballista as well as supported k8s / helm deployments. We should at least have documentation in the user guide for k8s / helm deployments.

AdheipSingh commented 2 years ago

thanks @andygrove

I will submit a PR for this soon for the helm charts with documentation.

AdheipSingh commented 2 years ago

@andygrove can we host ballista docker image. somehow for me the Dockerflie is broken on master branch. I was able to get it running but my machine runs out of resources, seems like the build is very resource intensive.

Here are few changes which i did to get it running, https://github.com/AdheipSingh/arrow-datafusion/commit/a591394917ebc6bb0b0fd93183e9020681745214

apache / datafusion

Helm Chart to deploy Ballista on kubernetes #2397