search

aws-samples / aws-glue-samples

AWS Glue code samples
MIT No Attribution
1.44k stars 821 forks source link

'glue/sparkui:latest' missing in Docker hub #102

Closed fwanghe closed 2 years ago

fwanghe commented 3 years ago

Hi all,

I got the error below when trying to load the spark ui with Docker. Anyone else has the same issue? Thanks


Loading Spark log in s3a://path-to-log
Unable to find image 'glue/sparkui:latest' locally
docker: Error response from daemon: pull access denied for glue/sparkui, repository does not exist or may require 'docker login': denied: requested access to the resource is denied.
See 'docker run --help'.
moomindani commented 2 years ago

This image is not hosted in Docker Hub. As you can see in README, you can build docker image using Dockerfile and use it.

cvargas-xbrein commented 1 year ago

Hi all,

I got the error below when trying to load the spark ui with Docker. Anyone else has the same issue? Thanks

Loading Spark log in s3a://path-to-log
Unable to find image 'glue/sparkui:latest' locally
docker: Error response from daemon: pull access denied for glue/sparkui, repository does not exist or may require 'docker login': denied: requested access to the resource is denied.
See 'docker run --help'.

try add this en dockerr run , works for me:
/bin/bash -c "/opt/spark/bin/spark-class org.apache.spark.deploy.history.HistoryServer"

moomindani commented 1 year ago

I guess you skipped docker build.