os-climate / osc-ingest-esg-spreadsheets

Ingest Shell-reported ESG Data (2020 GHG and Energy Data)
Apache License 2.0
0 stars 3 forks source link

Frequent, lengthy pauses in JupyterLab when editing notebook #2

Closed MichaelTiemannOSC closed 2 years ago

MichaelTiemannOSC commented 2 years ago

Describe the bug JupiterLab pauses for long times while I'm editing my notebooks. So long that Chrome tells me something I already know: the page is unresponsive. It always comes back, but these 20 second long pauses every time I type a parenthesis or a bracket is painful.

To Reproduce I am presently editing notebook/osc-ingest-v2.ipynb

Expected behavior I expect random pauses to be relatively infrequent and last at most a few seconds.

Screenshots If applicable, add screenshots to help explain your problem.

Additional context I have no idea whether to blame Chrome, JupyterLab, or the underlying EC2 cluster. Is it possible that our cluster is performance-challenged with its current configuration and workload?

If I have guessed wrongly in my assignment of this issue, please re-assign.

redmikhail commented 2 years ago

May not mean anything (keeping for the record )but following errors pretty consistently popping up in the log file of affected notebook

      "X-Forwarded-For": "45.37.104.66,::ffff:10.128.4.148",
      "Forwarded": "for=45.37.104.66;host=jupyterhub-odh-jupyterhub.apps.odh-cl1.apps.os-climate.org;proto=https",
      "X-Forwarded-Proto": "https,http",
      "X-Forwarded-Port": "443,80",
      "X-Forwarded-Host": "jupyterhub-odh-jupyterhub.apps.odh-cl1.apps.os-climate.org",
      "Host": "jupyterhub-odh-jupyterhub.apps.odh-cl1.apps.os-climate.org",
      "Cookie": "jupyterhub-user-michaeltiemannosc=[secret]; jupyterhub-session-id=[secret]; _xsrf=[secret]",
      "Accept-Language": "en-US,en;q=0.9,fr-FR;q=0.8,fr;q=0.7,ja;q=0.6",
      "Accept-Encoding": "gzip, deflate, br",
      "Referer": "https://jupyterhub-odh-jupyterhub.apps.odh-cl1.apps.os-climate.org/user/michaeltiemannosc/lab/tree/osc-ingest-shell/notebooks/osc-ingest-v3.ipynb",
      "Sec-Fetch-Dest": "empty",
      "Sec-Fetch-Mode": "cors",
      "Sec-Fetch-Site": "same-origin",
      "Origin": "https://jupyterhub-odh-jupyterhub.apps.odh-cl1.apps.os-climate.org",
      "Accept": "*/*",
      "Sec-Ch-Ua-Platform": "\"macOS\"",
      "User-Agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36",
      "Content-Type": "text/plain;charset=UTF-8",
      "Sec-Ch-Ua-Mobile": "?0",
      "X-Xsrftoken": "2|22baa56b|e770552299976b8994ce21ef87e0f7f7|1636592582",
      "Authorization": "token [secret]",
      "Sec-Ch-Ua": "\"Google Chrome\";v=\"95\", \"Chromium\";v=\"95\", \";Not A Brand\";v=\"99\"",
      "Content-Length": "53",
      "Connection": "close"
    }
[E 2021-11-11 12:30:30.869 SingleUserLabApp log:181] 500 POST /user/michaeltiemannosc/git/remote/fetch?1636633830787 (michaeltiemannosc@::ffff:10.128.4.148) 48.64ms 

In all cases it seems that this particular call is slower (40 - 60 ms )

MichaelTiemannOSC commented 2 years ago

This page suggests that the problem is that I'm sitting in the git view of my notebook, and I'm getting dinged frequently, harshly, and excessively for the fact that I don't have SSH setup:

https://pypi.org/project/jupyterlab-git/

If we have to set up SSH in order to get any kind of decent performance whatsoever from the JupyterLab environment, that should be mentioned in the developer requirements section of the docs. I was very much hoping that everything could be done with just a GitHub userid, and that we don't need an entire catalog of credentials and auth methods to get our work done.

MichaelTiemannOSC commented 2 years ago

This problem seems to have gone away. Closing (with fingers crossed).