jupyterhub / yarnspawner

Spawn JupyterHub single user notebook servers in Hadoop/YARN containers.
https://jupyterhub-yarnspawner.readthedocs.io/
BSD 3-Clause "New" or "Revised" License
19 stars 16 forks source link

Failed to connect to http://n:80/user/myuser/ ([Errno -2] Name or service not known) #22

Open Armelabdelkbir opened 2 years ago

Armelabdelkbir commented 2 years ago

Hello, since few days ago i'm trying to install a sandbox with jupyterhub on YARN cluster + LDAP, with version 1.4.1 as my production environment to do some tests, i follow this documentation https://jupyterhub-on-hadoop.readthedocs.io/en/latest/manual-spawner.html my application seems to be running with an application_id on yarn with no errors after login,

[D 2022-11-16 09:17:35.578 JupyterHub proxy:704] Proxy cmd: ['/usr/local/bin/configurable-http-proxy', '--ip', '10.1.2.38', '--port', '9999', '--api-ip', '127.0.0.1', '--api-port', '8001', '--error-target', 'http://10.1.2.38:8081/hub/error']
[D 2022-11-16 09:17:35.591 JupyterHub proxy:611] Writing proxy pid file: jupyterhub-proxy.pid
09:17:35.798 [ConfigProxy] info: Proxying http://10.1.2.38:9999 to (no default)
09:17:35.800 [ConfigProxy] info: Proxy API at http://127.0.0.1:8001/api/routes
[D 2022-11-16 09:17:36.361 JupyterHub proxy:739] Proxy started and appears to be up
[D 2022-11-16 09:17:36.378 JupyterHub proxy:832] Proxy: Fetching GET http://127.0.0.1:8001/api/routes
09:17:36.398 [ConfigProxy] info: 200 GET /api/routes 
[I 2022-11-16 09:17:36.399 JupyterHub app:2778] Hub API listening on http://10.1.2.38:8081/hub/
[D 2022-11-16 09:17:36.400 JupyterHub proxy:342] Fetching routes to check
[D 2022-11-16 09:17:36.400 JupyterHub proxy:832] Proxy: Fetching GET http://127.0.0.1:8001/api/routes
09:17:36.405 [ConfigProxy] info: 200 GET /api/routes 
[I 2022-11-16 09:17:36.407 JupyterHub proxy:347] Checking routes
[I 2022-11-16 09:17:36.407 JupyterHub proxy:432] Adding route for Hub: / => http://10.1.2.38:8081
[D 2022-11-16 09:17:36.408 JupyterHub proxy:832] Proxy: Fetching POST http://127.0.0.1:8001/api/routes/
09:17:36.414 [ConfigProxy] info: Adding route / -> http://10.1.2.38:8081
09:17:36.416 [ConfigProxy] info: Route added / -> http://10.1.2.38:8081
09:17:36.417 [ConfigProxy] info: 201 POST /api/routes/ 
[I 2022-11-16 09:17:36.418 JupyterHub app:2853] JupyterHub is now running at http://10.1.2.38:9999/
[D 2022-11-16 09:17:36.418 JupyterHub app:2456] It took 1.183 seconds for the Hub to start
....
.....
....
22/11/16 09:19:33 INFO impl.YarnClientImpl: Submitted application application_1668533569686_0004

but my notebook never start and i got this error

[I 2022-11-16 09:19:54.349 JupyterHub log:189] 200 GET /hub/api (@10.1.2.237) 2.69ms
[D 2022-11-16 09:19:54.383 JupyterHub users:779] Activity for user aarmel: 2022-11-16T09:19:54.265284Z
[D 2022-11-16 09:19:54.384 JupyterHub users:800] Activity on server aarmel/: 2022-11-16T09:19:54.265284Z
[I 2022-11-16 09:19:54.393 JupyterHub log:189] 200 POST /hub/api/users/aarmel/activity (aarmel@10.1.2.237) 25.90ms
[D 2022-11-16 09:19:54.622 JupyterHub spawner:1179] Polling subprocess every 30s
[W 2022-11-16 09:19:54.649 JupyterHub utils:233] Failed to connect to http://n:80/user/aarmel/ ([Errno -2] Name or service not known)
[W 2022-11-16 09:19:54.777 JupyterHub utils:233] Failed to connect to http://n:80/user/aarmel/ ([Errno -2] Name or service not known)
[W 2022-11-16 09:19:55.118 JupyterHub utils:233] Failed to connect to http://n:80/user/aarmel/ ([Errno -2] Name or service not known)
[W 2022-11-16 09:19:55.571 JupyterHub utils:233] Failed to connect to http://n:80/user/aarmel/ ([Errno -2] Name or service not known)
[W 2022-11-16 09:19:55.783 JupyterHub utils:233] Failed to connect to http://n:80/user/aarmel/ ([Errno -2] Name or service not known)
[W 2022-11-16 09:19:57.154 JupyterHub utils:233] Failed to connect to http://n:80/user/aarmel/ ([Errno -2] Name or service not known)

**STACK jupyterhub = 1.4.1 jupyterhub-singleuser= 1.4.1 IPython : 7.16.3 ipykernel : 5.5.6 jupyter_client : 7.1.2 jupyter_core : 4.9.2 jupyter_server : 1.13.1 jupyterlab : 3.0.16 nbclient : 0.5.9 nbconvert : 6.0.7 nbformat : 5.1.3 notebook : 6.0.3 traitlets : 4.3.3

nodejs : v14.17.1 configurable-http-proxy = 4.4.0

**Jupyterhub_conf c.JupyterHub.hub_bind_url = 'http://10.1.2.38:8081' c.JupyterHub.hub_connect_ip = '10.1.2.38' c.JupyterHub.ip = '10.1.2.38' c.JupyterHub.port = 9999 c.JupyterHub.ConfigurableHTTPProxy.command='/usr/local/bin/configurable-http-proxy' c.JupyterHub.spawner_class = 'yarnspawner.YarnSpawner' c.YarnSpawner.principal = jupyter_dev c.YarnSpawner.keytab = '/etc/security/keytabs/jupyter_dev.keytab' c.YarnSpawner.localize_files = { 'environment': { 'source': 'hdfs://dev/jupyterhub-env-dev/jupyterhub_env.tar.gz', 'visibility': 'public' } }

c.YarnSpawner.default_url = '/lab' c.YarnSpawner.queue='llap' c.YarnSpawner.cmd = ['python -m yarnspawner.jupyter_labhub'] c.YarnSpawner.prologue = 'source environment/bin/activate' c.YarnSpawner.args = ['--NotebookApp.contents_manager_class="hdfscm.HDFSContentsManager"'] c.YarnSpawner.mem_limit='4 G'

Any idea ? thanks

welcome[bot] commented 2 years ago

Thank you for opening your first issue in this project! Engagement like this is essential for open source projects! :hugs:
If you haven't done so already, check out Jupyter's Code of Conduct. Also, please try to follow the issue template as it helps other other community members to contribute more effectively. welcome You can meet the other Jovyans by joining our Discourse forum. There is also an intro thread there where you can stop by and say Hi! :wave:
Welcome to the Jupyter community! :tada:

welcome[bot] commented 1 year ago

Thank you for opening your first issue in this project! Engagement like this is essential for open source projects! :hugs:
If you haven't done so already, check out Jupyter's Code of Conduct. Also, please try to follow the issue template as it helps other other community members to contribute more effectively. welcome You can meet the other Jovyans by joining our Discourse forum. There is also an intro thread there where you can stop by and say Hi! :wave:
Welcome to the Jupyter community! :tada:

himanshuacceldata commented 1 month ago

Hi @Armelabdelkbir

How did you fix this I am facing similar kind of issue ?