apache / datafusion-ballista

Apache DataFusion Ballista Distributed Query Engine
https://datafusion.apache.org/ballista
Apache License 2.0
1.39k stars 181 forks source link

Deployment on AWS #886

Open ehenry2 opened 9 months ago

ehenry2 commented 9 months ago

Is your feature request related to a problem or challenge? Please describe what you are trying to do. I would like to deploy Ballista on AWS using ECS and AWS Batch. Although many organizations use kubernetes, it would be awesome to have more deployment options and patterns available for users. By making a pattern available for AWS batch in particular, it unlocks an economical way to run ephemeral batch jobs which can benefit by minimal startup time and resource usage of ballista.

Describe the solution you'd like Documentation and a cloudformation template similar to the helm chart for Kubernetes deployments.

Describe alternatives you've considered N/A

Additional context I'm interesting in contributing and working on this if there's interest.