search

opendatahub-io-contrib / jupyterhub-odh

Example JupyterHub deployment using OpenShift OAuth authenticator.
16 stars 31 forks source link

Long running notebook pod terminates after 24hr user access token expires #131

Open LaVLaS opened 2 years ago

LaVLaS commented 2 years ago

Describe the bug Source https://issues.redhat.com/browse/ODH-610

We have observed that a *User spawned Jupyterhub pod terminates right after the User's access token expires after 24 hours of creation of it. Is it an expected behavior (because I thought that the JupyterHub server continues running even after the token expires)? If not can you please guide us what can be the cause of this issue as it doesn't allow any of the users to *train their model continuously more than 24 hours which causes a huge problem.

ODH Version: 1.1.0 Openshift Version: 4.8.24 Platform: OVH Cloud

To Reproduce Steps to reproduce the behavior:

  1. Start a user notebook
  2. Start a long running notebook that last > 24hrs
  3. Notebook is terminated once the user token expires

Expected behavior User can be automatically logged out but the notebook pod is not terminated. The user should be able to login a with the notebook stil running

Screenshots N/A

Additional context N/A

k-e-r-n-e-l-p-a-n-i-c commented 2 years ago

Thank you @LaVLaS.