aws-samples / aws-glue-samples

AWS Glue code samples
MIT No Attribution
1.42k stars 812 forks source link

Request to Host Glue Spark UI Images on DockerHub #137

Open AlJohri opened 1 year ago

AlJohri commented 1 year ago

Currently I need to write a bunch of code to automatically download and build this docker image because I can't pull it directly from DockerHub.

echo "glue/sparkui image not found, building image..."
TEMPD=$(mktemp -d -t "glue-sparkui-XXXX")
if [ ! -e "$TEMPD" ]; then
    echo >&2 "Failed to create temp directory"
    exit 1
fi
cd "$TEMPD"
git clone https://github.com/aws-samples/aws-glue-samples.git
(cd aws-glue-samples/utilities/Spark_UI/glue-1_0-2_0 && docker build -t glue/sparkui:2.0 .)
(cd aws-glue-samples/utilities/Spark_UI/glue-3_0 && docker build -t glue/sparkui:3.0 .)
(cd aws-glue-samples/utilities/Spark_UI/glue-4_0 && docker build -t glue/sparkui:4.0 .)
cd -
rm -rf "$TEMPD"

Can these docker images be published directly to DockerHub so I can simply docker pull them and start using immediately?

I see that the aws-glue-libs are already hosted there: https://hub.docker.com/r/amazon/aws-glue-libs

Would be great to host the Spark UI as well!