jupyterhub / the-littlest-jupyterhub

Simple JupyterHub distribution for 1-100 users on a single server
https://tljh.jupyter.org
BSD 3-Clause "New" or "Revised" License
1.04k stars 341 forks source link

User server keeps getting stops #877

Closed erfanloghmani closed 1 year ago

erfanloghmani commented 1 year ago

Bug description

The jupyter server for the users keeps getting stopped, and they need to start them again using "Start My Server" button.

Looking at the journalctl log I see the following lines:

Apr 16 15:35:15 systemd[1]: Stopping /bin/bash -c cd /home/jupyter-erfanl && exec jupyterhub-singleuser --port=41703 --SingleUserNotebookApp.default_url=/lab...
Apr 16 15:35:15 bash[263004]: [C 2023-04-16 15:35:15.981 SingleUserNotebookApp notebookapp:1970] received signal 15, stopping
Apr 16 15:35:15 bash[263004]: [I 2023-04-16 15:35:15.984 SingleUserNotebookApp notebookapp:2164] Shutting down 3 kernels
Apr 16 15:35:15 bash[263004]: [I 2023-04-16 15:35:15.984 SingleUserNotebookApp multikernelmanager:242] Kernel shutdown: c8b36b49-0161-4fef-8754-9d4ce0f04428
Apr 16 15:35:16 bash[263004]: [I 2023-04-16 15:35:16.098 SingleUserNotebookApp multikernelmanager:242] Kernel shutdown: ac786c38-0726-4119-a6cf-936e5a746a18
Apr 16 15:35:16 bash[263004]: [I 2023-04-16 15:35:16.109 SingleUserNotebookApp multikernelmanager:242] Kernel shutdown: ec265ebb-97a8-4cf4-bfa8-f45268f93471
Apr 16 15:35:16 bash[263004]: [I 2023-04-16 15:35:16.121 SingleUserNotebookApp notebookapp:2179] Shutting down 2 terminals
Apr 16 15:35:16 bash[263004]: [I 2023-04-16 15:35:16.122 SingleUserNotebookApp management:233] EOF on FD 21; stopping reading
Apr 16 15:35:16 bash[263004]: [I 2023-04-16 15:35:16.222 SingleUserNotebookApp management:398] Terminal 1 closed
Apr 16 15:35:16 bash[263004]: [I 2023-04-16 15:35:16.223 SingleUserNotebookApp management:233] EOF on FD 22; stopping reading
Apr 16 15:35:16 bash[263004]: [I 2023-04-16 15:35:16.323 SingleUserNotebookApp management:398] Terminal 2 closed
Apr 16 15:35:16 systemd[1]: jupyter-erfanl.service: Succeeded.
Apr 16 15:35:16 systemd[1]: Stopped /bin/bash -c cd /home/jupyter-erfanl && exec jupyterhub-singleuser --port=41703 --SingleUserNotebookApp.default_url=/lab.

Expected behaviour

The server should continue to run.

Actual behaviour

Servers periodically get stopped

Your personal set up

Full environment ``` alembic==1.8.1 anyio==3.6.2 argon2-cffi @ file:///home/conda/feedstock_root/build_artifacts/argon2-cffi_1640817743617/work argon2-cffi-bindings @ file:///home/conda/feedstock_root/build_artifacts/argon2-cffi-bindings_1666850859330/work asttokens @ file:///home/conda/feedstock_root/build_artifacts/asttokens_1670263926556/work async-generator==1.10 attrs @ file:///home/conda/feedstock_root/build_artifacts/attrs_1671632566681/work Babel==2.10.3 backcall @ file:///home/conda/feedstock_root/build_artifacts/backcall_1592338393461/work backports.functools-lru-cache @ file:///home/conda/feedstock_root/build_artifacts/backports.functools_lru_cache_1618230623929/work beautifulsoup4 @ file:///home/conda/feedstock_root/build_artifacts/beautifulsoup4_1680888073205/work bleach @ file:///home/conda/feedstock_root/build_artifacts/bleach_1674535352125/work brotlipy==0.7.0 certifi==2022.12.7 certipy==0.1.3 cffi @ file:///home/conda/feedstock_root/build_artifacts/cffi_1631636250774/work chardet @ file:///home/conda/feedstock_root/build_artifacts/chardet_1610093492116/work charset-normalizer @ file:///home/conda/feedstock_root/build_artifacts/charset-normalizer_1626371162869/work colorama @ file:///home/conda/feedstock_root/build_artifacts/colorama_1602866480661/work comm @ file:///home/conda/feedstock_root/build_artifacts/comm_1679481329611/work conda==4.12.0 conda-package-handling @ file:///home/conda/feedstock_root/build_artifacts/conda-package-handling_1618231390031/work contourpy==1.0.7 cryptography @ file:///home/conda/feedstock_root/build_artifacts/cryptography_1633983255347/work cycler==0.11.0 debugpy==1.6.3 decorator @ file:///home/conda/feedstock_root/build_artifacts/decorator_1641555617451/work defusedxml @ file:///home/conda/feedstock_root/build_artifacts/defusedxml_1615232257335/work entrypoints @ file:///home/conda/feedstock_root/build_artifacts/entrypoints_1643888246732/work executing @ file:///home/conda/feedstock_root/build_artifacts/executing_1667317341051/work fastjsonschema @ file:///home/conda/feedstock_root/build_artifacts/python-fastjsonschema_1677336799617/work/dist flit_core @ file:///home/conda/feedstock_root/build_artifacts/flit-core_1667734568827/work/source/flit_core fonttools==4.39.3 greenlet==1.1.3.post0 idna @ file:///home/conda/feedstock_root/build_artifacts/idna_1609836280497/work importlib-metadata @ file:///home/conda/feedstock_root/build_artifacts/importlib-metadata_1681101609140/work importlib-resources @ file:///home/conda/feedstock_root/build_artifacts/importlib_resources_1676919000169/work ipykernel @ file:///home/conda/feedstock_root/build_artifacts/ipykernel_1673894597753/work ipython @ file:///home/conda/feedstock_root/build_artifacts/ipython_1680185408135/work ipython-genutils==0.2.0 ipywidgets==7.7.2 jedi @ file:///home/conda/feedstock_root/build_artifacts/jedi_1669134318875/work Jinja2 @ file:///home/conda/feedstock_root/build_artifacts/jinja2_1654302431367/work json5==0.9.10 jsonschema @ file:///home/conda/feedstock_root/build_artifacts/jsonschema-meta_1669810440410/work jupyter-resource-usage==0.6.3 jupyter-server==1.21.0 jupyter-telemetry==0.1.0 jupyter_client @ file:///home/conda/feedstock_root/build_artifacts/jupyter_client_1679365123476/work jupyter_core @ file:///home/conda/feedstock_root/build_artifacts/jupyter_core_1678994160714/work jupyterhub==1.5.0 jupyterlab==3.5.0 jupyterlab-pygments @ file:///home/conda/feedstock_root/build_artifacts/jupyterlab_pygments_1649936611996/work jupyterlab-widgets==1.1.1 jupyterlab_server==2.16.1 kiwisolver==1.4.4 Mako==1.2.3 mamba @ file:///home/conda/feedstock_root/build_artifacts/mamba_1632770295204/work MarkupSafe @ file:///home/conda/feedstock_root/build_artifacts/markupsafe_1674135804847/work matplotlib==3.7.1 matplotlib-inline @ file:///home/conda/feedstock_root/build_artifacts/matplotlib-inline_1660814786464/work mistune @ file:///home/conda/feedstock_root/build_artifacts/mistune_1675771498296/work nbclassic==0.4.5 nbclient @ file:///home/conda/feedstock_root/build_artifacts/nbclient_1680676954923/work nbconvert @ file:///home/conda/feedstock_root/build_artifacts/nbconvert-meta_1681137024412/work nbformat @ file:///home/conda/feedstock_root/build_artifacts/nbformat_1679336765223/work nbgitpuller==1.1.0 nest-asyncio @ file:///home/conda/feedstock_root/build_artifacts/nest-asyncio_1664684991461/work notebook==6.5.1 notebook_shim==0.2.0 nteract-on-jupyter==2.1.3 numpy==1.24.2 oauthlib==3.2.2 packaging @ file:///home/conda/feedstock_root/build_artifacts/packaging_1673482170163/work pamela==1.0.0 pandas==2.0.0 pandocfilters @ file:///home/conda/feedstock_root/build_artifacts/pandocfilters_1631603243851/work parso @ file:///home/conda/feedstock_root/build_artifacts/parso_1638334955874/work pexpect @ file:///home/conda/feedstock_root/build_artifacts/pexpect_1667297516076/work pickleshare @ file:///home/conda/feedstock_root/build_artifacts/pickleshare_1602536217715/work Pillow==9.5.0 pkgutil_resolve_name @ file:///home/conda/feedstock_root/build_artifacts/pkgutil-resolve-name_1633981968097/work platformdirs @ file:///home/conda/feedstock_root/build_artifacts/platformdirs_1679871349196/work prometheus-client @ file:///home/conda/feedstock_root/build_artifacts/prometheus_client_1674535637125/work prompt-toolkit @ file:///home/conda/feedstock_root/build_artifacts/prompt-toolkit_1677600924538/work psutil==5.9.4 ptyprocess @ file:///home/conda/feedstock_root/build_artifacts/ptyprocess_1609419310487/work/dist/ptyprocess-0.7.0-py2.py3-none-any.whl pure-eval @ file:///home/conda/feedstock_root/build_artifacts/pure_eval_1642875951954/work pycosat @ file:///home/conda/feedstock_root/build_artifacts/pycosat_1610094799048/work pycparser @ file:///home/conda/feedstock_root/build_artifacts/pycparser_1593275161868/work Pygments @ file:///home/conda/feedstock_root/build_artifacts/pygments_1681142969746/work pyOpenSSL @ file:///home/conda/feedstock_root/build_artifacts/pyopenssl_1633192417276/work pyparsing==3.0.9 pyrsistent @ file:///home/conda/feedstock_root/build_artifacts/pyrsistent_1672681476680/work PySocks @ file:///home/conda/feedstock_root/build_artifacts/pysocks_1610291451001/work python-dateutil @ file:///home/conda/feedstock_root/build_artifacts/python-dateutil_1626286286081/work python-json-logger==2.0.4 pytz==2022.5 pyzmq==24.0.1 requests @ file:///home/conda/feedstock_root/build_artifacts/requests_1626393743643/work ruamel-yaml-conda @ file:///home/conda/feedstock_root/build_artifacts/ruamel_yaml_1611943432947/work ruamel.yaml==0.17.21 ruamel.yaml.clib==0.2.7 seaborn==0.12.2 Send2Trash @ file:///home/conda/feedstock_root/build_artifacts/send2trash_1628511208346/work six @ file:///home/conda/feedstock_root/build_artifacts/six_1620240208055/work sniffio==1.3.0 soupsieve @ file:///home/conda/feedstock_root/build_artifacts/soupsieve_1658207591808/work SQLAlchemy==1.4.42 stack-data @ file:///home/conda/feedstock_root/build_artifacts/stack_data_1669632077133/work terminado @ file:///home/conda/feedstock_root/build_artifacts/terminado_1670253674810/work tinycss2 @ file:///home/conda/feedstock_root/build_artifacts/tinycss2_1666100256010/work tomli==2.0.1 tornado @ file:///home/conda/feedstock_root/build_artifacts/tornado_1666788587690/work tqdm @ file:///home/conda/feedstock_root/build_artifacts/tqdm_1632160078689/work traitlets @ file:///home/conda/feedstock_root/build_artifacts/traitlets_1675110562325/work typing_extensions @ file:///home/conda/feedstock_root/build_artifacts/typing_extensions_1678559861143/work tzdata==2023.3 urllib3 @ file:///home/conda/feedstock_root/build_artifacts/urllib3_1632350318291/work wcwidth @ file:///home/conda/feedstock_root/build_artifacts/wcwidth_1673864653149/work webencodings==0.5.1 websocket-client==1.4.1 widgetsnbextension==3.6.1 zipp @ file:///home/conda/feedstock_root/build_artifacts/zipp_1677313463193/work ```
Configuration ```python # jupyterhub_config.py ```
Logs ``` # paste relevant logs here, if any ```
welcome[bot] commented 1 year ago

Thank you for opening your first issue in this project! Engagement like this is essential for open source projects! :hugs:
If you haven't done so already, check out Jupyter's Code of Conduct. Also, please try to follow the issue template as it helps other other community members to contribute more effectively. welcome You can meet the other Jovyans by joining our Discourse forum. There is also an intro thread there where you can stop by and say Hi! :wave:
Welcome to the Jupyter community! :tada:

katrinabryce commented 1 year ago

I did

sudo tljh-config set services.cull.max_age 0
sudo tljh-config set services.cull.enabled false

to stop this from happening.

erfanloghmani commented 1 year ago

Thank you very much, Katrina. Yeah, I also turned off the culling to stop this. For anyone that gets into this problem in the future, this page is helpful and gives more information.

erfanloghmani commented 1 year ago

I'm closing the issue.