pynapple-org / pynapple

PYthon Neural Analysis Package :pineapple:
https://pynapple.org/
MIT License
279 stars 63 forks source link

Fatal exception using pynapple in IPython console #318

Open cameron-woodard opened 3 months ago

cameron-woodard commented 3 months ago

Hi, I'm running scripts that use pynapple through an IPython console in the Spyder IDE and I keep running into the following error:

Windows fatal exception: access violation

Thread 0x00005968 (most recent call first): File "C:\Users\Cam\miniconda3\envs\pynapple\lib\site-packages\zmq\utils\garbage.py", line 47 in run File "C:\Users\Cam\miniconda3\envs\pynapple\lib\threading.py", line 932 in _bootstrap_inner File "C:\Users\Cam\miniconda3\envs\pynapple\lib\threading.py", line 890 in _bootstrap

Main thread: Current thread 0x000037a0 (most recent call first): File "C:\Users\Cam\miniconda3\envs\pynapple\lib\site-packages\pynapple\core_core_functions.py", line 33 in _count File "C:\Users\Cam\miniconda3\envs\pynapple\lib\site-packages\pynapple\core\ts_group.py", line 704 in count File "c:\users\cam\documents\python scripts\ephys analysis\be05_behavior_spiking_analysis.py", line 1845 in File "C:\Users\Cam\miniconda3\envs\pynapple\lib\site-packages\spyder_kernels\py3compat.py", line 356 in compat_exec File "C:\Users\Cam\miniconda3\envs\pynapple\lib\site-packages\spyder_kernels\customize\spydercustomize.py", line 473 in exec_code File "C:\Users\Cam\miniconda3\envs\pynapple\lib\site-packages\spyder_kernels\customize\spydercustomize.py", line 740 in _exec_cell File "C:\Users\Cam\miniconda3\envs\pynapple\lib\site-packages\spyder_kernels\customize\spydercustomize.py", line 689 in runcell File "C:\Users\Cam\AppData\Local\Temp\ipykernel_20848\4094378172.py", line 1 in

This results in the kernel crashing and restarting. The first section with the garbage collection thread is not always present, so I don't think that has anything to do with it. It looks to me like the issue happens when the count function is called? It doesn't happen every time I use count, but invariably occurs when I'm running loops that involve shuffling unit activity and running count hundreds of times. I tried deleting the pynapple environment and making it again from scratch but it didn't help. I'm using the latest version of pynapple. Any ideas?

gviejo commented 3 months ago

Hi Ok it's a weird error. Does it happen if you call it outside spyder?

The function count is compiled with numba under the hood. It might be an issue with numba here but not sure. If you are comfortable with it, you can try to disable the compiling of the count function with the following steps:

git clone git@github.com:pynapple-org/pynapple.git cd pynapple Make sure you are in the right conda environment pip install -e . Open ~/pynapple/pynapple/core/_jitted_functions.py amd comment line 120. Call again your scripts

If it works, there might be an incompatibility with numba with something else. If it doesn't work, you can paste the error here.

gviejo commented 1 month ago

Hello do you have any update about this issue?

gaelias commented 2 weeks ago

Hi,

I've run into a similar error. I figured I'd post it here rather than start a new thread given the similarity.

I'm running in a custom environment with Jupyter Notebook in VSCode. Intermittently my kernal crashes with an ExitCode: 3221225477 and the Reason: is blank. I peppered my code with print statements and found that it happens most frequently with count() but I've also had it happen during compute_perievent(). I've noticed it's more likely to happen when I run subsequent views of the same data. For example, if I run my analysis aligned to trial start and then to trial end it's more likely to crash when I examine the trial end alignment.

I've commented out line 120 from _jitted_functions.py and can confirm that count() still kills the kernal sometimes.

edit: updated to reflect I have had the kernal die since commenting out the jit decorator

gviejo commented 2 weeks ago

Hi Gabriel, are you on windows too? Does it happen too when you are outside vscode? Like in a simple terminal.

gaelias commented 2 weeks ago

I am on windows. I haven't tried running outside of vscode. I'm new to python and don't know how to do it any other way.

gviejo commented 2 weeks ago

If you have installed anaconda, you should be able to open a terminal by typing anaconda powershell. Then activate your environment with conda activate your_env_name. After that, you can type ipython and you should have ipython ready. If not you can still install it with pip install ipython. Within ipython, you can run your script with run yourscript.py

It is a very weird error and we suspect it's windows specific. Pynapple is tested against all OS but clearly it's something that escape the tests.

cameron-woodard commented 2 weeks ago

Hi, Sorry for taking so long to respond. Back when I first ran into this issue, I tried commenting out the line in jitted_functions and this didn't seem to help - I was still was getting the error. However, now going back to test it again, I can't seem to replicate the error, regardless of whether the line in _jitted_functions.py is commented out or not. It's possible that I updated Spyder or some other dependent packages in the environment that resolved this. Thanks for your feedback and suggestions regardless.

gaelias commented 2 weeks ago

@gviejo is your recommendation to use ipython to test if vscode is a issue or jupyter? My processing pipeline is currently in a jupyter notebook. I could try running it in Spyder notebook if the concern is that vscode is doing something wonky. Otherwise I could probably shove it all into a .py file to run with ipython.

Side note, last night I changed almost all my .count() calls to .count().to_numpy() and everything seems to be substantially more stable now. Since then my kernal has only died during .compute_perievent() calls, which are comparatively rare to how frequently it was crashing on .count()

gviejo commented 2 weeks ago

Yes i would try only a py file first. It seems to me that the program is trying to access some files that don't exist at time of execution. When loading your data are you using NWB or not?

gaelias commented 2 weeks ago

No, I'm using code from the lab that pulls from the kilosort outputs and creates a TsGroup from that.

gaelias commented 2 weeks ago

@gviejo at this point I've had the chance to run multiple instances of both the .ipynb version of my code in vscode, and the .py copy in ipython. I've had my vscode kernal crash a handful of times, every time at .compute_perievent(), while the ipython version hasn't crashed once. I even copied 10x calls of my code where I call .compute_perievent() to try to up the chances of the issue arising and it hasn't crashed once.

gviejo commented 2 weeks ago

Thanks for testing it. Could you post your vscode version, your python version, the version of the packages you used, the way you installed your environment and if possible a minimal script around compute_perievent?

gaelias commented 2 weeks ago

vscode version: 1.94.2 python version 3.10.14

I created the environment following the lab instructions here: https://github.com/dbheadley/mimo_pack, with additional conda installs of Nemos and sklearn.

As for the specific code, the spiking data is read in as a TsGroup using the as_pynapple function defined in loadphy.py (https://github.com/dbheadley/mimo_pack/tree/main/mimo_pack/fileio). My compute_perievents() call is the first line in a function that gets passed the spks object as_pynapple returns, as well as event timestamps and the relative time windows. Here's a snippet

def EDM_Preprocess_Ensemble(data, event_times, window=(-3,3), bin_size=0.025, *args, **kwargs): print('Computing Peri-Event') perievent = nap.compute_perievent(data, event_times, window)

Installed packages (copied from conda list): aiohappyeyeballs 2.4.3 pypi_0 pypi aiohttp 3.10.10 pypi_0 pypi aiosignal 1.3.1 pypi_0 pypi alabaster 1.0.0 pypi_0 pypi anyio 4.4.0 pypi_0 pypi argon2-cffi 23.1.0 pypi_0 pypi argon2-cffi-bindings 21.2.0 pypi_0 pypi arrow 1.3.0 py310haa95532_0 astroid 3.3.5 pypi_0 pypi asttokens 2.4.1 pypi_0 pypi async-lru 2.0.4 pypi_0 pypi async-timeout 4.0.3 pypi_0 pypi asyncssh 2.17.0 pypi_0 pypi atomicwrites 1.4.1 pypi_0 pypi attrs 23.2.0 pypi_0 pypi autopep8 2.0.4 pyhd3eb1b0_0 babel 2.15.0 pypi_0 pypi backports-tarfile 1.2.0 pypi_0 pypi bcrypt 3.2.0 py310h2bbff1b_1 beautifulsoup4 4.12.3 py310haa95532_0 binaryornot 0.4.4 pyhd3eb1b0_1 black 24.10.0 pypi_0 pypi blas 1.0 mkl bleach 6.1.0 pypi_0 pypi brotli 1.1.0 hcfcfb64_1 conda-forge brotli-bin 1.1.0 hcfcfb64_1 conda-forge brotli-python 1.0.9 py310hd77b12b_8 bzip2 1.0.8 h2466b09_7 conda-forge ca-certificates 2024.9.24 haa95532_0 certifi 2024.8.30 py310haa95532_0 cffi 1.16.0 pypi_0 pypi chardet 5.2.0 pypi_0 pypi charset-normalizer 3.3.2 pyhd3eb1b0_0 click 8.1.7 py310haa95532_0 cloudpickle 3.1.0 pypi_0 pypi colorama 0.4.6 pyhd8ed1ab_0 conda-forge comm 0.2.2 pypi_0 pypi contourpy 1.2.1 py310h232114e_0 conda-forge cookiecutter 2.6.0 py310haa95532_0 cryptography 43.0.3 pypi_0 pypi cycler 0.12.1 pyhd8ed1ab_0 conda-forge dclut 0.0.3 pypi_0 pypi debugpy 1.8.2 pypi_0 pypi decorator 5.1.1 pyhd3eb1b0_0 defusedxml 0.7.1 pyhd3eb1b0_0 deprecated 1.2.14 pypi_0 pypi diff-match-patch 20241021 pypi_0 pypi dill 0.3.9 pypi_0 pypi docstring-to-markdown 0.15 pypi_0 pypi docutils 0.21.2 pypi_0 pypi exceptiongroup 1.2.2 pypi_0 pypi executing 2.0.1 pypi_0 pypi fastjsonschema 2.20.0 pypi_0 pypi fileio 0.3 pypi_0 pypi flake8 7.1.1 pypi_0 pypi fonttools 4.53.1 py310ha8f682b_0 conda-forge fqdn 1.5.1 pypi_0 pypi freetype 2.12.1 hdaf720e_2 conda-forge frozenlist 1.5.0 pypi_0 pypi glib 2.78.4 hd77b12b_0 glib-tools 2.78.4 hd77b12b_0 gst-plugins-base 1.22.3 hfc3ed34_1 gstreamer 1.22.3 h1779075_1 h11 0.14.0 pypi_0 pypi h5py 3.11.0 pypi_0 pypi hdmf 3.14.2 pypi_0 pypi httpcore 1.0.5 pypi_0 pypi httpx 0.27.0 pypi_0 pypi icu 73.2 h63175ca_0 conda-forge idna 3.7 py310haa95532_0 imagesize 1.4.1 py310haa95532_0 importlib-metadata 8.0.0 pypi_0 pypi importlib_metadata 7.0.1 hd3eb1b0_0 inflection 0.5.1 pypi_0 pypi iniconfig 2.0.0 pypi_0 pypi intel-openmp 2024.2.0 h57928b3_980 conda-forge intervaltree 3.1.0 pyhd3eb1b0_0 ipykernel 6.29.5 py310haa95532_0 ipython 8.26.0 pypi_0 pypi isoduration 20.11.0 pypi_0 pypi isort 5.13.2 py310haa95532_0 jaraco-classes 3.4.0 pypi_0 pypi jaraco-context 5.3.0 pypi_0 pypi jaraco-functools 4.0.1 pypi_0 pypi jaraco.classes 3.2.1 pyhd3eb1b0_0 jax 0.4.31 pypi_0 pypi jaxlib 0.4.31 pypi_0 pypi jaxopt 0.8.3 pypi_0 pypi jedi 0.19.1 py310haa95532_0 jellyfish 1.1.0 pypi_0 pypi jinja2 3.1.4 py310haa95532_0 joblib 1.4.2 pyhd8ed1ab_0 conda-forge jpeg 9e h827c3e9_3 json5 0.9.25 pypi_0 pypi jsonpointer 3.0.0 pypi_0 pypi jsonschema 4.23.0 py310haa95532_0 jsonschema-specifications 2023.12.1 pypi_0 pypi jupyter-client 8.6.2 pypi_0 pypi jupyter-events 0.10.0 pypi_0 pypi jupyter-lsp 2.2.5 pypi_0 pypi jupyter-server 2.14.2 pypi_0 pypi jupyter-server-terminals 0.5.3 pypi_0 pypi jupyter_client 8.6.0 py310haa95532_0 jupyter_core 5.7.2 py310haa95532_0 jupyterlab 4.2.4 pypi_0 pypi jupyterlab-pygments 0.3.0 pypi_0 pypi jupyterlab-server 2.27.3 pypi_0 pypi jupyterlab_pygments 0.2.2 py310haa95532_0 keyring 25.2.1 pypi_0 pypi kiwisolver 1.4.5 py310h232114e_1 conda-forge krb5 1.20.1 h5b6d351_0 lazy-object-proxy 1.10.0 py310h2bbff1b_0 lcms2 2.12 h83e58a3_0 lerc 3.0 hd77b12b_0 libblas 3.9.0 1_h8933c1f_netlib conda-forge libbrotlicommon 1.1.0 hcfcfb64_1 conda-forge libbrotlidec 1.1.0 hcfcfb64_1 conda-forge libbrotlienc 1.1.0 hcfcfb64_1 conda-forge libcblas 3.9.0 5_hd5c7e75_netlib conda-forge libclang 14.0.6 default_hb5a9fac_1 libclang13 14.0.6 default_h8e68704_1 libdeflate 1.17 h2bbff1b_1 libffi 3.4.2 h8ffe710_5 conda-forge libglib 2.78.4 ha17d25a_0 libhwloc 2.11.1 default_h8125262_1000 conda-forge libiconv 1.17 hcfcfb64_2 conda-forge libintl 0.22.5 h5728263_2 conda-forge libintl-devel 0.22.5 h5728263_2 conda-forge libjpeg-turbo 2.0.0 h196d8e1_0 liblapack 3.9.0 5_hd5c7e75_netlib conda-forge libogg 1.3.5 h2466b09_0 conda-forge libpng 1.6.43 h19919ed_0 conda-forge libpq 12.17 h906ac69_0 libsodium 1.0.18 h62dcd97_0 libspatialindex 1.9.3 h6c2663c_0 libsqlite 3.46.0 h2466b09_0 conda-forge libtiff 4.5.1 hd77b12b_0 libvorbis 1.3.7 h0e60522_0 conda-forge libwebp-base 1.4.0 hcfcfb64_0 conda-forge libxcb 1.16 hcd874cb_0 conda-forge libxml2 2.13.1 h24da03e_2 libzlib 1.2.13 h2466b09_6 conda-forge llvmlite 0.43.0 pypi_0 pypi m2w64-gcc-libgfortran 5.3.0 6 conda-forge m2w64-gcc-libs 5.3.0 7 conda-forge m2w64-gcc-libs-core 5.3.0 7 conda-forge m2w64-gmp 6.1.0 2 conda-forge m2w64-libwinpthread-git 5.0.0.4634.697f757 2 conda-forge markdown-it-py 3.0.0 pypi_0 pypi markupsafe 2.1.5 pypi_0 pypi matplotlib 3.9.2 py310haa95532_0 matplotlib-base 3.9.2 py310h37e0a56_1 conda-forge matplotlib-inline 0.1.7 pypi_0 pypi mccabe 0.7.0 pyhd3eb1b0_0 mdurl 0.1.2 pypi_0 pypi mimo-pack 0.0.0 dev_0 mistune 3.0.2 pypi_0 pypi mkl 2023.2.0 h6a75c08_49573 conda-forge mkl-service 2.4.0 py310h2bbff1b_1 mkl_fft 1.3.10 py310h827c3e9_0 mkl_random 1.2.7 py310hc64d2fc_0 ml-dtypes 0.4.0 pypi_0 pypi more-itertools 10.3.0 py310haa95532_0 msys2-conda-epoch 20160418 1 conda-forge multidict 6.1.0 pypi_0 pypi munkres 1.1.4 pyh9f0ad1d_0 conda-forge mypy_extensions 1.0.0 py310haa95532_0 nbclient 0.10.0 pypi_0 pypi nbconvert 7.16.4 py310haa95532_0 nbformat 5.10.4 py310haa95532_0 nemos 0.1.6 pypi_0 pypi nest-asyncio 1.6.0 py310haa95532_0 nh3 0.2.18 pypi_0 pypi notebook 7.2.1 pypi_0 pypi notebook-shim 0.2.4 pypi_0 pypi numba 0.60.0 pypi_0 pypi numpy 1.26.4 py310h055cbcc_0 numpy-base 1.26.4 py310h65a83cf_0 numpydoc 1.8.0 pypi_0 pypi openjpeg 2.5.2 hae555c5_0 openssl 3.3.1 h2466b09_2 conda-forge opt-einsum 3.3.0 pypi_0 pypi overrides 7.7.0 pypi_0 pypi packaging 24.1 pyhd8ed1ab_0 conda-forge pandas 2.2.2 py310hb4db72f_1 conda-forge pandocfilters 1.5.1 pypi_0 pypi paramiko 2.8.1 pyhd3eb1b0_0 parso 0.8.4 pypi_0 pypi pathspec 0.12.1 pypi_0 pypi patsy 0.5.6 pyhd8ed1ab_0 conda-forge pcre2 10.42 h0ff8eda_1 pexpect 4.9.0 pypi_0 pypi pickleshare 0.7.5 pyhd3eb1b0_1003 pillow 10.4.0 py310h827c3e9_0 pip 24.0 pyhd8ed1ab_0 conda-forge pkginfo 1.10.0 pypi_0 pypi platformdirs 4.2.2 pypi_0 pypi plotly 5.23.0 pypi_0 pypi pluggy 1.5.0 pypi_0 pypi ply 3.11 pyhd8ed1ab_2 conda-forge prometheus-client 0.20.0 pypi_0 pypi prompt-toolkit 3.0.47 pypi_0 pypi prompt_toolkit 3.0.43 hd3eb1b0_0 propcache 0.2.0 pypi_0 pypi psutil 6.0.0 pypi_0 pypi pthread-stubs 0.4 hcd874cb_1001 conda-forge pthreads-win32 2.9.1 hfa6e2cd_3 conda-forge ptyprocess 0.7.0 pyhd3eb1b0_2 pure-eval 0.2.3 pypi_0 pypi pure_eval 0.2.2 pyhd3eb1b0_0 pyabf 2.3.8 pypi_0 pypi pycodestyle 2.12.1 pypi_0 pypi pycparser 2.22 pypi_0 pypi pydocstyle 6.3.0 py310haa95532_0 pyflakes 3.2.0 py310haa95532_0 pygithub 2.4.0 pypi_0 pypi pygments 2.18.0 pypi_0 pypi pyjwt 2.9.0 pypi_0 pypi pylint 3.3.1 pypi_0 pypi pylint-venv 3.0.3 py310haa95532_0 pyls-spyder 0.4.0 pypi_0 pypi pynacl 1.5.0 py310h8cc25b3_0 pynapple 0.7.1 pypi_0 pypi pynwb 2.8.1 pypi_0 pypi pyparsing 3.1.2 pyhd8ed1ab_0 conda-forge pyqt 5.15.10 py310hd77b12b_0 pyqt5-sip 12.15.0 pypi_0 pypi pyqtwebengine 5.15.7 pypi_0 pypi pyqtwebengine-qt5 5.15.2 pypi_0 pypi pysocks 1.7.1 py310haa95532_0 pytest 8.3.1 pypi_0 pypi python 3.10.14 h4de0772_0_cpython conda-forge python-dateutil 2.9.0 pyhd8ed1ab_0 conda-forge python-fastjsonschema 2.16.2 py310haa95532_0 python-json-logger 2.0.7 pypi_0 pypi python-lsp-black 2.0.0 py310haa95532_0 python-lsp-jsonrpc 1.1.2 pyhd3eb1b0_0 python-lsp-server 1.12.0 pypi_0 pypi python-slugify 8.0.4 pypi_0 pypi python-tzdata 2024.1 pyhd8ed1ab_0 conda-forge python_abi 3.10 4_cp310 conda-forge pytoolconfig 1.3.1 pypi_0 pypi pytz 2024.1 pyhd8ed1ab_0 conda-forge pyuca 1.2 pypi_0 pypi pywavelets 1.6.0 py310hb0944cc_0 conda-forge pywin32 306 pypi_0 pypi pywin32-ctypes 0.2.2 py310haa95532_0 pywinpty 2.0.13 pypi_0 pypi pyyaml 6.0.1 pypi_0 pypi pyzmq 26.0.3 pypi_0 pypi qdarkstyle 3.2.3 pyhd3eb1b0_0 qhull 2020.2 hc790b64_5 conda-forge qstylizer 0.2.3 pypi_0 pypi qt 5.15.7 haa95532_0 qt-main 5.15.2 h19c9488_10 qt-webengine 5.15.9 h5bd16bc_7 qtawesome 1.3.1 py310haa95532_0 qtconsole 5.6.0 pypi_0 pypi qtpy 2.4.1 py310haa95532_0 readme-renderer 44.0 pypi_0 pypi referencing 0.35.1 pypi_0 pypi requests 2.32.3 py310haa95532_0 requests-toolbelt 1.0.0 pypi_0 pypi rfc3339-validator 0.1.4 pypi_0 pypi rfc3986 2.0.0 pypi_0 pypi rfc3986-validator 0.1.1 pypi_0 pypi rich 13.7.1 py310haa95532_0 rope 1.13.0 pypi_0 pypi rpds-py 0.19.0 pypi_0 pypi rtree 1.3.0 pypi_0 pypi ruamel-yaml 0.18.6 pypi_0 pypi ruamel-yaml-clib 0.2.8 pypi_0 pypi scikit-learn 1.5.1 py310hf2a6c47_0 conda-forge scipy 1.14.0 py310h46043a1_1 conda-forge seaborn 0.13.2 hd8ed1ab_2 conda-forge seaborn-base 0.13.2 pyhd8ed1ab_2 conda-forge send2trash 1.8.3 pypi_0 pypi setuptools 71.0.4 pyhd8ed1ab_0 conda-forge sip 6.7.12 py310h00ffb61_0 conda-forge six 1.16.0 pyh6c4a22f_0 conda-forge sniffio 1.3.1 pypi_0 pypi snowballstemmer 2.2.0 pyhd3eb1b0_0 sortedcontainers 2.4.0 pyhd3eb1b0_0 soupsieve 2.5 py310haa95532_0 sphinx 8.1.3 pypi_0 pypi sphinxcontrib-applehelp 2.0.0 pypi_0 pypi sphinxcontrib-devhelp 2.0.0 pypi_0 pypi sphinxcontrib-htmlhelp 2.1.0 pypi_0 pypi sphinxcontrib-jsmath 1.0.1 pyhd3eb1b0_0 sphinxcontrib-qthelp 2.0.0 pypi_0 pypi sphinxcontrib-serializinghtml 2.0.0 pypi_0 pypi spyder 6.0.1 pypi_0 pypi spyder-kernels 3.0.0 pypi_0 pypi sqlite 3.45.3 h2bbff1b_0 stack-data 0.6.3 pypi_0 pypi stack_data 0.2.0 pyhd3eb1b0_0 statsmodels 0.14.2 py310hb0944cc_0 conda-forge superqt 0.6.7 pypi_0 pypi tabulate 0.9.0 py310haa95532_0 tbb 2021.12.0 hc790b64_3 conda-forge tenacity 9.0.0 pypi_0 pypi terminado 0.18.1 pypi_0 pypi text-unidecode 1.3 pyhd3eb1b0_0 textdistance 4.6.3 pypi_0 pypi threadpoolctl 3.5.0 pyhc1e730c_0 conda-forge three-merge 0.1.1 pyhd3eb1b0_0 tinycss2 1.3.0 pypi_0 pypi tk 8.6.13 h5226925_1 conda-forge toml 0.10.2 pyhd8ed1ab_0 conda-forge tomli 2.0.1 pyhd8ed1ab_0 conda-forge tomlkit 0.13.2 py310haa95532_0 tornado 6.4.1 py310ha8f682b_0 conda-forge tqdm 4.66.4 pyhd8ed1ab_0 conda-forge traitlets 5.14.3 py310haa95532_0 twine 5.1.1 pypi_0 pypi types-python-dateutil 2.9.0.20240316 pypi_0 pypi typing-extensions 4.12.2 pypi_0 pypi typing_extensions 4.11.0 py310haa95532_0 tzdata 2024a h0c530f3_0 conda-forge ucrt 10.0.22621.0 h57928b3_0 conda-forge ujson 5.10.0 py310h5da7b33_0 unicodedata2 15.1.0 py310h8d17308_0 conda-forge unidecode 1.3.8 py310haa95532_0 uri-template 1.3.0 pypi_0 pypi urllib3 2.2.2 pypi_0 pypi vc 14.3 h8a93ad2_20 conda-forge vc14_runtime 14.40.33810 ha82c5b3_20 conda-forge vs2015_runtime 14.40.33810 h3bf8584_20 conda-forge watchdog 5.0.3 pypi_0 pypi wcwidth 0.2.13 pypi_0 pypi webcolors 24.6.0 pypi_0 pypi webencodings 0.5.1 pypi_0 pypi websocket-client 1.8.0 pypi_0 pypi whatthepatch 1.0.6 pypi_0 pypi wheel 0.43.0 pyhd8ed1ab_1 conda-forge win_inet_pton 1.1.0 py310haa95532_0 wrapt 1.16.0 pypi_0 pypi xarray 2023.6.0 py310haa95532_0 xorg-libxau 1.0.11 hcd874cb_0 conda-forge xorg-libxdmcp 1.1.3 hcd874cb_0 conda-forge xz 5.4.6 h8cc25b3_1 yaml 0.2.5 he774522_0 yapf 0.40.2 py310haa95532_0 yarl 1.16.0 pypi_0 pypi zeromq 4.3.5 hd77b12b_0 zipp 3.19.2 pypi_0 pypi zlib 1.2.13 h2466b09_6 conda-forge zstd 1.5.6 h0ea2cb4_0 conda-forge

gaelias commented 18 hours ago

@gviejo was there anything in my environment that stood out as problematic?

Quick update, I'm happy to report I haven't had issues lately. I moved most of my code out of jupyter notebooks and into dedicated .py files. I also started working from pickled data files rather than compiling from .bin each time. Not sure if it was either, or a combination of the two, but things are seemingly stable now.