Open finnoshea opened 1 year ago
Actually, this appears to happen when python closes.
I've seen this before too! It is hard for me to reproduce, though. When I run your exact code right now, I don't get the errors (upon closing, or otherwise).
Can you give me some details of the environment you're using? Give me the output of which python
.
which python
returns nothing. I'm running inside a singularity container on SDF. Here is what I get from pip freeze
:
aiosignal==1.3.1 argon2-cffi==21.3.0 argon2-cffi-bindings==21.2.0 arrow==1.2.3 asttokens==2.2.1 attrs==23.1.0 backcall==0.2.0 beautifulsoup4==4.12.2 bleach==6.0.0 blinker==1.6.2 bokeh==2.4.3 certifi==2023.5.7 cffi==1.15.1 cftime==1.6.2 charset-normalizer==3.1.0 click==8.1.3 cloudpickle==2.2.1 cmake==3.26.4 colorcet==3.0.1 comm==0.1.3 contourpy==1.0.7 cycler==0.11.0 dash==2.9.3 dash-core-components==2.0.0 dash-html-components==2.0.0 dash-table==5.0.0 dask==2023.4.1 datashader==0.14.4 datashape==0.5.2 debugpy==1.6.7 decorator==5.1.1 defusedxml==0.7.1 epicscorelibs==7.0.7.99.0.0 executing==1.2.0 fastjsonschema==2.16.3 ffmpeg==1.4 filelock==3.12.0 Flask==2.3.2 fonttools==4.39.4 fqdn==1.5.1 frozenlist==1.3.3 fsspec==2023.4.0 grpcio==1.51.3 h5py==3.8.0 holoviews==1.15.4 idna==3.4 imageio==2.28.1 importlib-metadata==6.6.0 ipykernel==6.22.0 ipython==8.13.2 ipython-genutils==0.2.0 isoduration==20.11.0 itsdangerous==2.1.2 jedi==0.18.2 Jinja2==3.1.2 joblib==1.2.0 jsonpointer==2.3 jsonschema==4.17.3 jupyter-events==0.6.3 jupyter_client==8.2.0 jupyter_core==5.3.0 jupyter_server==2.5.0 jupyter_server_terminals==0.4.4 jupyterlab-pygments==0.2.2 kiwisolver==1.4.4 lazy_loader==0.2 lit==16.0.5.post0 llvmlite==0.39.1 locket==1.0.0 Markdown==3.4.3 MarkupSafe==2.1.2 matplotlib==3.7.1 matplotlib-inline==0.1.6 meme @ git+https://github.com/slaclab/meme/@af07afe431fa4503664aca8d9f83f786f85abbf0 mistune==2.0.5 mpmath==1.3.0 msgpack==1.0.5 multipledispatch==0.6.0 nbclassic==1.0.0 nbclient==0.7.4 nbconvert==7.3.1 nbformat==5.8.0 nest-asyncio==1.5.6 netCDF4==1.6.3 networkx==3.1 nose2==0.13.0 notebook==6.5.4 notebook_shim==0.2.3 numba==0.56.4 numpy==1.23.5 nvidia-cublas-cu11==11.10.3.66 nvidia-cuda-cupti-cu11==11.7.101 nvidia-cuda-nvrtc-cu11==11.7.99 nvidia-cuda-runtime-cu11==11.7.99 nvidia-cudnn-cu11==8.5.0.96 nvidia-cufft-cu11==10.9.0.58 nvidia-curand-cu11==10.2.10.91 nvidia-cusolver-cu11==11.4.0.1 nvidia-cusparse-cu11==11.7.4.91 nvidia-nccl-cu11==2.14.3 nvidia-nvtx-cu11==11.7.91 p4p==4.1.6 packaging==23.1 pandas==2.0.2 pandocfilters==1.5.0 panel==0.14.4 param==1.13.0 parso==0.8.3 partd==1.4.0 pexpect==4.8.0 pickleshare==0.7.5 Pillow==9.5.0 platformdirs==3.5.0 plotly==5.14.1 ply==3.11 pooch==1.7.0 prometheus-client==0.16.0 prompt-toolkit==3.0.38 protobuf==3.20.3 psutil==5.9.5 ptyprocess==0.7.0 pure-eval==0.2.2 pvxslibs==1.2.0 pyarrow==12.0.0 pycparser==2.21 pyct==0.5.0 Pygments==2.15.1 pyparsing==3.0.9 pyrsistent==0.19.3 python-dateutil==2.8.2 python-json-logger==2.0.7 pytz==2023.3 pyviz-comms==2.2.1 PyWavelets==1.4.1 PyYAML==6.0 pyzmq==25.0.2 ray==2.5.0 requests==2.31.0 rfc3339-validator==0.1.4 rfc3986-validator==0.1.1 ruamel.yaml==0.17.31 ruamel.yaml.clib==0.2.7 scikit-image==0.20.0 scikit-learn==1.2.1 scipy==1.10.1 Send2Trash==1.8.2 setuptools-dso==2.8 shap==0.41.0 shapely==2.0.1 six==1.16.0 slicer==0.0.7 sniffio==1.3.0 soupsieve==2.4.1 stack-data==0.6.2 streamz==0.6.4 sympy==1.12 tenacity==8.2.2 tensorboardX==2.6 terminado==0.17.1 threadpoolctl==3.1.0 tifffile==2023.4.12 tinycss2==1.2.1 toolz==0.12.0 torch==2.0.1 torchvision==0.15.2 tornado==6.3.1 tqdm==4.65.0 traitlets==5.9.0 triton==2.0.0 typing_extensions==4.6.3 tzdata==2023.3 uri-template==1.2.0 urllib3==2.0.3 wcwidth==0.2.6 webcolors==1.13 webencodings==0.5.1 websocket-client==1.5.1 Werkzeug==2.3.3 xarray==2023.4.2 zict==3.0.0 zipp==3.15.0
It looks like p4p is trying to close _ClientProvider in python 3. This happens when python is exit()
ed, so the garbage collector is going through and del
ing things but maybe the close method hasn't been implemented in p4p 4.1.6, so there is nothing to call.
When I run this script:
I get an error after all the PVs have been fetched:
This looks like a problem with p4p, but maybe there is something meme can do to close this more gently.