search

awslabs / aws-glue-libs

AWS Glue Libraries are additions and enhancements to Spark for ETL operations.
Other
635 stars 299 forks source link

Local development Jupyter lab 404 not found #161

Closed mo2menelzeiny closed 1 year ago

mo2menelzeiny commented 1 year ago

Hey, I'm using macOs Ventura 13.1 and I'm trying to follow the developing locally guide on AWS documentation here https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-libraries.html However, Jupyter lab url http://127.0.0.1:8888/lab gives me a 404, any idea what is going on?

image

Here is my command:

docker run -it -v ~/.aws:/home/glue_user/.aws -v $JUPYTER_WORKSPACE_LOCATION:/home/glue_user/workspace/jupyter_workspace/ -e AWS_PROFILE=$PROFILE_NAME -e DISABLE_SSL=true --rm -p 4040:4040 -p 18080:18080 -p 8998:8998 -p 8888:8888 --name glue_jupyter_lab amazon/aws-glue-libs:glue_libs_3.0.0_image_01 /home/glue_user/jupyter/jupyter_start.sh

Here is the output:

starting org.apache.spark.deploy.history.HistoryServer, logging to /home/glue_user/spark/logs/spark-glue_user-org.apache.spark.deploy.history.HistoryServer-1-9136b872377c.out
starting java  -cp /home/glue_user/livy/jars/*:/home/glue_user/livy/conf:/home/glue_user/spark/conf:/home/glue_user/spark/conf: org.apache.livy.server.LivyServer, logging to /home/glue_user/livy/logs/livy-glue_user-server.out
SSL Disabled
[I 2022-12-20 11:35:30.115 ServerApp] jupyterlab | extension was successfully linked.
[I 2022-12-20 11:35:30.199 ServerApp] nbclassic | extension was successfully linked.
[I 2022-12-20 11:35:30.211 ServerApp] Writing Jupyter server cookie secret to /home/glue_user/.local/share/jupyter/runtime/jupyter_cookie_secret
[I 2022-12-20 11:35:34.487 ServerApp] sparkmagic | extension was found and enabled by notebook_shim. Consider moving the extension to Jupyter Server's extension paths.
[I 2022-12-20 11:35:34.488 ServerApp] sparkmagic | extension was successfully linked.
[I 2022-12-20 11:35:34.488 ServerApp] notebook_shim | extension was successfully linked.
[W 2022-12-20 11:35:34.593 ServerApp] All authentication is disabled.  Anyone who can connect to this server will be able to run code.
[I 2022-12-20 11:35:34.602 ServerApp] notebook_shim | extension was successfully loaded.
[I 2022-12-20 11:35:34.610 LabApp] JupyterLab extension loaded from /home/glue_user/.local/lib/python3.7/site-packages/jupyterlab
[I 2022-12-20 11:35:34.610 LabApp] JupyterLab application directory is /home/glue_user/.local/share/jupyter/lab
[I 2022-12-20 11:35:34.635 ServerApp] jupyterlab | extension was successfully loaded.
[I 2022-12-20 11:35:34.660 ServerApp] nbclassic | extension was successfully loaded.
[I 2022-12-20 11:35:34.661 ServerApp] sparkmagic extension enabled!
[I 2022-12-20 11:35:34.662 ServerApp] sparkmagic | extension was successfully loaded.
[I 2022-12-20 11:35:34.665 ServerApp] Serving notebooks from local directory: /home/glue_user/workspace/jupyter_workspace
[I 2022-12-20 11:35:34.666 ServerApp] Jupyter Server 1.18.1 is running at:
[I 2022-12-20 11:35:34.666 ServerApp] http://9136b872377c:8888/lab
[I 2022-12-20 11:35:34.666 ServerApp]  or http://127.0.0.1:8888/lab
[I 2022-12-20 11:35:34.666 ServerApp] Use Control-C to stop this server and shut down all kernels (twice to skip confirmation).
mo2menelzeiny commented 1 year ago

Closing as the issue was I had another instance of Jupyter lab already running on my machine