apache / datafusion-ballista

Apache DataFusion Ballista Distributed Query Engine
https://datafusion.apache.org/ballista
Apache License 2.0
1.4k stars 182 forks source link

Publish official Docker images as part of release process #455

Open andygrove opened 3 years ago

andygrove commented 3 years ago

Is your feature request related to a problem or challenge? Please describe what you are trying to do. When we release DataFusion and Ballista we should publish Docker images to the Apache Docker Hub repo for the following:

Describe the solution you'd like We should see how Apache Airflow does this.

Describe alternatives you've considered Alternative is relying on users to build and publish their own Docker images, as Apache Spark does.

Additional context None

jorgecarleitao commented 3 years ago

Excellent idea.

andygrove commented 2 years ago

@houqp Are you familiar with how Airflow publishes Docker images?

houqp commented 2 years ago

@andygrove they are built and pushed manually to dockerhub during the release process as convenient packages, not as part of the official release, see https://github.com/apache/airflow/tree/32bfb2f8ad3ac7314a2f6ff5e59567914b07a2b6/dev#apache-airflow-package. This means they don't have to vote on the docker image.

I think we could adopt the same pattern for ballista since we are still in early development phase.