search

jupyterhub / yarnspawner

Spawn JupyterHub single user notebook servers in Hadoop/YARN containers.
https://jupyterhub-yarnspawner.readthedocs.io/
BSD 3-Clause "New" or "Revised" License
19 stars 16 forks source link

yarn application is failing #19

Open qliksenseuser opened 4 years ago

qliksenseuser commented 4 years ago

Hi

We are seeing application being created in Yarn but get failed. Below is the error log we captured. For IP purpose replace servername and ip address as much as possible. we are seeing unknown queue jupyterhub.

20/06/23 10:54:54 DEBUG skein.Driver: Starting Skein version 0.8.0 20/06/23 10:54:54 DEBUG skein.Driver: Logging in using ticket cache 20/06/23 10:54:55 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 20/06/23 10:54:55 WARN shortcircuit.DomainSocketFactory: The short-circuit local reads feature cannot be used because libhadoop cannot be loaded. 20/06/23 10:54:55 INFO impl.TimelineClientImpl: Timeline service address: http://servername:8188/ws/v1/timeline/ 20/06/23 10:54:56 INFO client.AHSProxy: Connecting to Application History server at servername/IPAddress:10200 20/06/23 10:54:56 INFO skein.Driver: Driver started, listening on 43931 20/06/23 10:54:56 DEBUG skein.Driver: Reporting gRPC server port back to the launching process 20/06/23 10:54:56 INFO impl.TimelineClientImpl: Timeline service address: http://servername:8188/ws/v1/timeline/ 20/06/23 10:54:56 INFO client.AHSProxy: Connecting to Application History server at servername/IPAddress:10200 20/06/23 10:54:56 INFO skein.Driver: Uploading application resources to hdfs://hdpcluster01/user/jupyterhub/.skein/application_1592762333481_0079 20/06/23 10:54:57 DEBUG skein.Driver: Uploading file:/opt/jupyterhub/minicondabash/lib/python3.7/site-packages/skein/java/skein.jar to hdfs://clustername/user/jupyterhub/.skein/application_1592762333481_0079/skein.jar 20/06/23 10:54:57 DEBUG skein.Driver: Writing application specification to hdfs://clustername/user/jupyterhub/.skein/application_1592762333481_0079/.skein.proto 20/06/23 10:54:57 INFO skein.Driver: Submitting application... 20/06/23 10:54:57 DEBUG skein.Driver: Deleted application directory hdfs://clustername/user/jupyterhub/.skein/application_1592762333481_0079

welcome[bot] commented 4 years ago

Thank you for opening your first issue in this project! Engagement like this is essential for open source projects! :hugs:
If you haven't done so already, check out Jupyter's Code of Conduct. Also, please try to follow the issue template as it helps other other community members to contribute more effectively. welcome You can meet the other Jovyans by joining our Discourse forum. There is also an intro thread there where you can stop by and say Hi! :wave:
Welcome to the Jupyter community! :tada: