search

jupyterhub / yarnspawner

Spawn JupyterHub single user notebook servers in Hadoop/YARN containers.
https://jupyterhub-yarnspawner.readthedocs.io/
BSD 3-Clause "New" or "Revised" License
19 stars 16 forks source link

impossible to use more than 50% of the selected core of container #20

Open MhmtErsy opened 4 years ago

MhmtErsy commented 4 years ago

Bug description

I have a problem with JupyterHub-YarnSpawner. When I launch a X core-Y GB server. I can't use more than 50% of the X core. I have been using CDH platform with YARN that configured as Fair Scheduler.

For example I launched a server with 8 core 16 GB. There is no problem with memory, I can use 100% of 16G but I cannot exceed more than 4 core. Is this a bug related with YARN or YARN Fair Scheduler ?

welcome[bot] commented 4 years ago

Thank you for opening your first issue in this project! Engagement like this is essential for open source projects! :hugs:
If you haven't done so already, check out Jupyter's Code of Conduct. Also, please try to follow the issue template as it helps other other community members to contribute more effectively. welcome You can meet the other Jovyans by joining our Discourse forum. There is also an intro thread there where you can stop by and say Hi! :wave:
Welcome to the Jupyter community! :tada: