pymc-devs / nutpie

Python wrapper for nuts-rs
MIT License
110 stars 10 forks source link

nutpie freezes on linux server #148

Closed Dekermanjian closed 1 month ago

Dekermanjian commented 1 month ago

I apologize beforehand as I don't know how to provide a reproducible example. I am basically running a simple pymc model on a Linux server running Rocky Linux. I am able to sample using the pymc and numpyro samplers but when I try to use nutpie it just freezes. The same model runs perfectly fine on a windows machine.

maresb commented 1 month ago

Hi @Dekermanjian! Could you please provide some more info? In particular a conda list or if you're not using conda/mamba/pixi then pip freeze? Can you share the model that's crashing?

Dekermanjian commented 1 month ago

Yes, of course. I want to make sure that it is clear that it is not crashing it just freezes and doesn't sample. here is the conda list output:

# Name                    Version                   Build  Channel
_libgcc_mutex             0.1                 conda_forge    conda-forge
_openmp_mutex             4.5                  2_kmp_llvm    conda-forge
_sysroot_linux-64_curr_repodata_hack 3                   h69a702a_16    conda-forge
adal                      1.2.7                    pypi_0    pypi
adlfs                     2023.8.0                 pypi_0    pypi
aiobotocore               2.5.4                    pypi_0    pypi
aiofiles                  24.1.0                   pypi_0    pypi
aiohappyeyeballs          2.4.0                    pypi_0    pypi
aiohttp                   3.10.5                   pypi_0    pypi
aioitertools              0.11.0                   pypi_0    pypi
aiosignal                 1.3.1                    pypi_0    pypi
antlr4-python3-runtime    4.9.3                    pypi_0    pypi
anyconfig                 0.14.0                   pypi_0    pypi
anyio                     3.7.1                    pypi_0    pypi
appdirs                   1.4.4                    pypi_0    pypi
applicationinsights       0.11.10                  pypi_0    pypi
argcomplete               3.3.0                    pypi_0    pypi
argon2-cffi               23.1.0                   pypi_0    pypi
argon2-cffi-bindings      21.2.0                   pypi_0    pypi
arrow                     1.3.0                    pypi_0    pypi
arviz                     0.19.0                   pypi_0    pypi
asttokens                 2.4.1                    pypi_0    pypi
async-timeout             4.0.3                    pypi_0    pypi
attrs                     24.2.0                   pypi_0    pypi
azure-ai-ml               1.12.1                   pypi_0    pypi
azure-cli-core            2.63.0                   pypi_0    pypi
azure-cli-telemetry       1.1.0                    pypi_0    pypi
azure-common              1.1.28                   pypi_0    pypi
azure-core                1.30.2                   pypi_0    pypi
azure-datalake-store      0.0.53                   pypi_0    pypi
azure-graphrbac           0.61.1                   pypi_0    pypi
azure-identity            1.17.1                   pypi_0    pypi
azure-mgmt-authorization  4.0.0                    pypi_0    pypi
azure-mgmt-containerregistry 10.3.0                   pypi_0    pypi
azure-mgmt-core           1.4.0                    pypi_0    pypi
azure-mgmt-keyvault       10.3.1                   pypi_0    pypi
azure-mgmt-network        26.0.0                   pypi_0    pypi
azure-mgmt-resource       23.1.1                   pypi_0    pypi
azure-mgmt-storage        21.2.1                   pypi_0    pypi
azure-storage-blob        12.22.0                  pypi_0    pypi
azure-storage-file-datalake 12.16.0                  pypi_0    pypi
azure-storage-file-share  12.17.0                  pypi_0    pypi
azureml-core              1.57.0                   pypi_0    pypi
azureml-dataprep          5.1.6                    pypi_0    pypi
azureml-dataprep-native   41.0.0                   pypi_0    pypi
azureml-dataprep-rslex    2.22.3                   pypi_0    pypi
azureml-fsspec            1.3.1                    pypi_0    pypi
babel                     2.16.0                   pypi_0    pypi
backports-tempfile        1.0                      pypi_0    pypi
backports-weakref         1.0.post1                pypi_0    pypi
bcrypt                    4.2.0                    pypi_0    pypi
beautifulsoup4            4.12.3                   pypi_0    pypi
binaryornot               0.4.4                    pypi_0    pypi
binutils_impl_linux-64    2.40                 ha1999f0_7    conda-forge
black                     22.12.0                  pypi_0    pypi
blas                      2.123                       mkl    conda-forge
blas-devel                3.9.0            23_linux64_mkl    conda-forge
bleach                    6.1.0                    pypi_0    pypi
blinker                   1.8.2                    pypi_0    pypi
botocore                  1.31.17                  pypi_0    pypi
build                     1.2.1                    pypi_0    pypi
bzip2                     1.0.8                h4bc722e_7    conda-forge
ca-certificates           2024.7.4             hbcca054_0    conda-forge
cachetools                5.5.0                    pypi_0    pypi
certifi                   2024.7.4                 pypi_0    pypi
cffi                      1.17.0                   pypi_0    pypi
cfgv                      3.4.0                    pypi_0    pypi
chardet                   5.2.0                    pypi_0    pypi
charset-normalizer        3.3.2                    pypi_0    pypi
click                     8.1.7                    pypi_0    pypi
cloudpickle               2.2.1                    pypi_0    pypi
colorama                  0.4.6                    pypi_0    pypi
comm                      0.2.2                    pypi_0    pypi
cons                      0.4.6                    pypi_0    pypi
contextlib2               21.6.0                   pypi_0    pypi
contourpy                 1.3.0                    pypi_0    pypi
cookiecutter              2.6.0                    pypi_0    pypi
coverage                  7.6.1                    pypi_0    pypi
cryptography              43.0.0                   pypi_0    pypi
cycler                    0.12.1                   pypi_0    pypi
dash                      2.17.1                   pypi_0    pypi
dash-ag-grid              2.4.0                    pypi_0    pypi
dash-bootstrap-components 1.6.0                    pypi_0    pypi
dash-core-components      2.0.0                    pypi_0    pypi
dash-html-components      2.0.0                    pypi_0    pypi
dash-table                5.0.0                    pypi_0    pypi
debugpy                   1.8.5                    pypi_0    pypi
decorator                 5.1.1                    pypi_0    pypi
defusedxml                0.7.1                    pypi_0    pypi
deltalake                 0.19.1                   pypi_0    pypi
distlib                   0.3.8                    pypi_0    pypi
distro                    1.9.0                    pypi_0    pypi
dm-tree                   0.1.8                    pypi_0    pypi
docker                    7.1.0                    pypi_0    pypi
dynaconf                  3.2.6                    pypi_0    pypi
entrypoints               0.4                      pypi_0    pypi
et-xmlfile                1.1.0                    pypi_0    pypi
etuples                   0.3.9                    pypi_0    pypi
evidently                 0.4.16                   pypi_0    pypi
exceptiongroup            1.2.2                    pypi_0    pypi
executing                 2.0.1                    pypi_0    pypi
faker                     28.0.0                   pypi_0    pypi
fastapi                   0.112.2                  pypi_0    pypi
fastexcel                 0.11.6                   pypi_0    pypi
fastjsonschema            2.20.0                   pypi_0    pypi
filelock                  3.15.4                   pypi_0    pypi
flake8                    4.0.1                    pypi_0    pypi
flask                     3.0.3                    pypi_0    pypi
fonttools                 4.53.1                   pypi_0    pypi
frozenlist                1.4.1                    pypi_0    pypi
fsspec                    2023.5.0                 pypi_0    pypi
gcc                       14.1.0               h6f9ffa1_1    conda-forge
gcc_impl_linux-64         14.1.0               h3c94d91_1    conda-forge
gitdb                     4.0.11                   pypi_0    pypi
gitpython                 3.1.43                   pypi_0    pypi
google-api-core           2.19.2                   pypi_0    pypi
google-auth               2.34.0                   pypi_0    pypi
googleapis-common-protos  1.65.0                   pypi_0    pypi
graphql-core              3.2.3                    pypi_0    pypi
greenlet                  3.0.3                    pypi_0    pypi
gunicorn                  21.2.0                   pypi_0    pypi
gxx                       14.1.0               h6f9ffa1_1    conda-forge
gxx_impl_linux-64         14.1.0               h8d00ecb_1    conda-forge
h11                       0.14.0                   pypi_0    pypi
h5netcdf                  1.3.0                    pypi_0    pypi
h5py                      3.11.0                   pypi_0    pypi
httpcore                  1.0.5                    pypi_0    pypi
httptools                 0.6.1                    pypi_0    pypi
httpx                     0.27.2                   pypi_0    pypi
humanfriendly             10.0                     pypi_0    pypi
icu                       75.1                 he02047a_0    conda-forge
identify                  2.6.0                    pypi_0    pypi
idna                      3.8                      pypi_0    pypi
importlib-metadata        6.11.0                   pypi_0    pypi
importlib-resources       6.4.4                    pypi_0    pypi
iniconfig                 2.0.0                    pypi_0    pypi
ipykernel                 6.29.5                   pypi_0    pypi
ipython                   8.21.0                   pypi_0    pypi
ipython-genutils          0.2.0                    pypi_0    pypi
ipywidgets                8.1.5                    pypi_0    pypi
isodate                   0.6.1                    pypi_0    pypi
isort                     5.13.2                   pypi_0    pypi
iterative-telemetry       0.0.8                    pypi_0    pypi
itsdangerous              2.2.0                    pypi_0    pypi
jax                       0.4.31                   pypi_0    pypi
jaxlib                    0.4.31                   pypi_0    pypi
jedi                      0.19.1                   pypi_0    pypi
jeepney                   0.8.0                    pypi_0    pypi
jinja2                    3.1.4                    pypi_0    pypi
jmespath                  1.0.1                    pypi_0    pypi
joblib                    1.4.2                    pypi_0    pypi
json5                     0.9.25                   pypi_0    pypi
jsonpickle                3.2.2                    pypi_0    pypi
jsonschema                4.23.0                   pypi_0    pypi
jsonschema-specifications 2023.12.1                pypi_0    pypi
jupyter                   1.0.0                    pypi_0    pypi
jupyter-client            7.4.9                    pypi_0    pypi
jupyter-console           6.6.3                    pypi_0    pypi
jupyter-core              5.7.2                    pypi_0    pypi
jupyter-server            1.24.0                   pypi_0    pypi
jupyterlab                3.5.3                    pypi_0    pypi
jupyterlab-pygments       0.3.0                    pypi_0    pypi
jupyterlab-server         2.15.2                   pypi_0    pypi
jupyterlab-widgets        3.0.13                   pypi_0    pypi
kedro                     0.18.14                  pypi_0    pypi
kedro-datasets            2.0.0                    pypi_0    pypi
kedro-telemetry           0.2.5                    pypi_0    pypi
kedro-viz                 6.7.0                    pypi_0    pypi
kernel-headers_linux-64   3.10.0              h4a8ded7_16    conda-forge
kiwisolver                1.4.5                    pypi_0    pypi
knack                     0.11.0                   pypi_0    pypi
lazy-loader               0.4                      pypi_0    pypi
ld_impl_linux-64          2.40                 hf3520f5_7    conda-forge
libblas                   3.9.0            23_linux64_mkl    conda-forge
libcblas                  3.9.0            23_linux64_mkl    conda-forge
libffi                    3.4.2                h7f98852_5    conda-forge
libgcc                    14.1.0               h77fa898_1    conda-forge
libgcc-devel_linux-64     14.1.0             h5d3d1c9_101    conda-forge
libgcc-ng                 14.1.0               h69a702a_1    conda-forge
libgfortran               14.1.0               h69a702a_1    conda-forge
libgfortran-ng            14.1.0               h69a702a_1    conda-forge
libgfortran5              14.1.0               hc5f4f2c_1    conda-forge
libgomp                   14.1.0               h77fa898_1    conda-forge
libhwloc                  2.11.1          default_hecaa2ac_1000    conda-forge
libiconv                  1.17                 hd590300_2    conda-forge
liblapack                 3.9.0            23_linux64_mkl    conda-forge
liblapacke                3.9.0            23_linux64_mkl    conda-forge
libnsl                    2.0.1                hd590300_0    conda-forge
libopenblas               0.3.28          pthreads_h94d23a6_0    conda-forge
libsanitizer              14.1.0               hcba0ae0_1    conda-forge
libsqlite                 3.46.0               hde9e2c9_0    conda-forge
libstdcxx                 14.1.0               hc0a3c3a_1    conda-forge
libstdcxx-devel_linux-64  14.1.0             h5d3d1c9_101    conda-forge
libstdcxx-ng              14.1.0               h4852527_1    conda-forge
libuuid                   2.38.1               h0b41bf4_0    conda-forge
libxcrypt                 4.4.36               hd590300_1    conda-forge
libxml2                   2.12.7               he7c6b58_4    conda-forge
libzlib                   1.3.1                h4ab18f5_1    conda-forge
litestar                  2.11.0                   pypi_0    pypi
llvm-openmp               18.1.8               hf5423f3_1    conda-forge
llvmlite                  0.43.0                   pypi_0    pypi
logical-unification       0.4.6                    pypi_0    pypi
markdown-it-py            3.0.0                    pypi_0    pypi
markupsafe                2.1.5                    pypi_0    pypi
marshmallow               3.22.0                   pypi_0    pypi
matplotlib                3.9.2                    pypi_0    pypi
matplotlib-inline         0.1.7                    pypi_0    pypi
mccabe                    0.6.1                    pypi_0    pypi
mdurl                     0.1.2                    pypi_0    pypi
minikanren                1.0.3                    pypi_0    pypi
mistune                   3.0.2                    pypi_0    pypi
mkl                       2024.1.0           ha957f24_693    conda-forge
mkl-devel                 2024.1.0           ha770c72_693    conda-forge
mkl-include               2024.1.0           ha957f24_693    conda-forge
ml-dtypes                 0.4.0                    pypi_0    pypi
mltable                   1.6.1                    pypi_0    pypi
more-itertools            10.4.0                   pypi_0    pypi
msal                      1.30.0                   pypi_0    pypi
msal-extensions           1.2.0                    pypi_0    pypi
msgspec                   0.18.6                   pypi_0    pypi
msrest                    0.7.1                    pypi_0    pypi
msrestazure               0.6.4.post1              pypi_0    pypi
multidict                 6.0.5                    pypi_0    pypi
multipledispatch          1.0.0                    pypi_0    pypi
mypy-extensions           1.0.0                    pypi_0    pypi
nbclassic                 1.1.0                    pypi_0    pypi
nbclient                  0.10.0                   pypi_0    pypi
nbconvert                 7.16.4                   pypi_0    pypi
nbformat                  5.10.4                   pypi_0    pypi
nbstripout                0.7.1                    pypi_0    pypi
ncurses                   6.5                  he02047a_1    conda-forge
ndg-httpsclient           0.5.1                    pypi_0    pypi
nest-asyncio              1.6.0                    pypi_0    pypi
networkx                  3.3                      pypi_0    pypi
nltk                      3.9.1                    pypi_0    pypi
nodeenv                   1.9.1                    pypi_0    pypi
notebook                  6.5.7                    pypi_0    pypi
notebook-shim             0.2.4                    pypi_0    pypi
numba                     0.60.0                   pypi_0    pypi
numpy                     1.26.4                   pypi_0    pypi
nutpie                    0.13.2                   pypi_0    pypi
oauthlib                  3.2.2                    pypi_0    pypi
omegaconf                 2.3.0                    pypi_0    pypi
opencensus                0.11.4                   pypi_0    pypi
opencensus-context        0.1.3                    pypi_0    pypi
opencensus-ext-azure      1.1.13                   pypi_0    pypi
openpyxl                  3.1.5                    pypi_0    pypi
openssl                   3.3.1                hb9d3cd8_3    conda-forge
opt-einsum                3.3.0                    pypi_0    pypi
orjson                    3.10.7                   pypi_0    pypi
packaging                 23.2                     pypi_0    pypi
pandas                    2.2.2                    pypi_0    pypi
pandocfilters             1.5.1                    pypi_0    pypi
paramiko                  3.4.1                    pypi_0    pypi
parse                     1.20.2                   pypi_0    pypi
parso                     0.8.4                    pypi_0    pypi
pathspec                  0.12.1                   pypi_0    pypi
patsy                     0.5.6                    pypi_0    pypi
pexpect                   4.9.0                    pypi_0    pypi
pillow                    10.4.0                   pypi_0    pypi
pip                       24.2               pyhd8ed1ab_0    conda-forge
pip-tools                 7.4.1                    pypi_0    pypi
pkginfo                   1.11.1                   pypi_0    pypi
platformdirs              4.2.2                    pypi_0    pypi
plotly                    5.23.0                   pypi_0    pypi
pluggy                    1.2.0                    pypi_0    pypi
polars                    1.5.0                    pypi_0    pypi
polyfactory               2.16.2                   pypi_0    pypi
portalocker               2.10.1                   pypi_0    pypi
pre-commit                3.8.0                    pypi_0    pypi
prometheus-client         0.20.0                   pypi_0    pypi
prompt-toolkit            3.0.47                   pypi_0    pypi
proto-plus                1.24.0                   pypi_0    pypi
protobuf                  5.27.4                   pypi_0    pypi
psutil                    6.0.0                    pypi_0    pypi
psycopg2-binary           2.9.9                    pypi_0    pypi
ptyprocess                0.7.0                    pypi_0    pypi
pure-eval                 0.2.3                    pypi_0    pypi
pyarrow                   16.1.0                   pypi_0    pypi
pyasn1                    0.6.0                    pypi_0    pypi
pyasn1-modules            0.4.0                    pypi_0    pypi
pycodestyle               2.8.0                    pypi_0    pypi
pycparser                 2.22                     pypi_0    pypi
pydantic                  1.10.18                  pypi_0    pypi
pydash                    7.0.5                    pypi_0    pypi
pyflakes                  2.4.0                    pypi_0    pypi
pygments                  2.18.0                   pypi_0    pypi
pyjwt                     2.9.0                    pypi_0    pypi
pymc                      5.15.1                   pypi_0    pypi
pymc-experimental         0.1.1                    pypi_0    pypi
pynacl                    1.5.0                    pypi_0    pypi
pyodbc                    5.1.0                    pypi_0    pypi
pyopenssl                 24.2.1                   pypi_0    pypi
pyparsing                 3.1.4                    pypi_0    pypi
pyproject-hooks           1.1.0                    pypi_0    pypi
pysocks                   1.7.1                    pypi_0    pypi
pytensor                  2.22.1                   pypi_0    pypi
pytest                    7.4.4                    pypi_0    pypi
pytest-cov                3.0.0                    pypi_0    pypi
pytest-mock               1.13.0                   pypi_0    pypi
python                    3.10.14         hd12c33a_0_cpython    conda-forge
python-dateutil           2.9.0.post0              pypi_0    pypi
python-dotenv             1.0.1                    pypi_0    pypi
python-slugify            8.0.4                    pypi_0    pypi
pytoolconfig              1.3.1                    pypi_0    pypi
pytz                      2024.1                   pypi_0    pypi
pyyaml                    6.0.2                    pypi_0    pypi
pyzmq                     26.2.0                   pypi_0    pypi
qtconsole                 5.5.2                    pypi_0    pypi
qtpy                      2.4.1                    pypi_0    pypi
readline                  8.2                  h8228510_1    conda-forge
referencing               0.35.1                   pypi_0    pypi
regex                     2024.7.24                pypi_0    pypi
requests                  2.32.3                   pypi_0    pypi
requests-oauthlib         2.0.0                    pypi_0    pypi
retrying                  1.3.4                    pypi_0    pypi
rich                      13.8.0                   pypi_0    pypi
rich-click                1.8.3                    pypi_0    pypi
rope                      1.13.0                   pypi_0    pypi
rpds-py                   0.20.0                   pypi_0    pypi
rsa                       4.9                      pypi_0    pypi
s3fs                      2023.5.0                 pypi_0    pypi
scikit-learn              1.5.1                    pypi_0    pypi
scipy                     1.14.1                   pypi_0    pypi
secretstorage             3.3.3                    pypi_0    pypi
secure                    0.3.0                    pypi_0    pypi
send2trash                1.8.3                    pypi_0    pypi
setuptools                72.2.0             pyhd8ed1ab_0    conda-forge
shellingham               1.5.4                    pypi_0    pypi
six                       1.16.0                   pypi_0    pypi
smmap                     5.0.1                    pypi_0    pypi
sniffio                   1.3.1                    pypi_0    pypi
soupsieve                 2.6                      pypi_0    pypi
sqlalchemy                2.0.32                   pypi_0    pypi
stack-data                0.6.3                    pypi_0    pypi
starlette                 0.38.2                   pypi_0    pypi
statsmodels               0.14.2                   pypi_0    pypi
strawberry-graphql        0.237.3                  pypi_0    pypi
strictyaml                1.7.3                    pypi_0    pypi
sysroot_linux-64          2.17                h4a8ded7_16    conda-forge
tabulate                  0.9.0                    pypi_0    pypi
tbb                       2021.12.0            h434a139_3    conda-forge
tenacity                  9.0.0                    pypi_0    pypi
terminado                 0.18.1                   pypi_0    pypi
text-unidecode            1.3                      pypi_0    pypi
threadpoolctl             3.5.0                    pypi_0    pypi
tinycss2                  1.3.0                    pypi_0    pypi
tk                        8.6.13          noxft_h4845f30_101    conda-forge
toml                      0.10.2                   pypi_0    pypi
tomli                     2.0.1                    pypi_0    pypi
toolz                     0.12.1                   pypi_0    pypi
toposort                  1.10                     pypi_0    pypi
tornado                   6.4.1                    pypi_0    pypi
tqdm                      4.66.5                   pypi_0    pypi
traitlets                 5.9.0                    pypi_0    pypi
typer                     0.12.5                   pypi_0    pypi
types-python-dateutil     2.9.0.20240821           pypi_0    pypi
typing-extensions         4.12.2                   pypi_0    pypi
typing-inspect            0.9.0                    pypi_0    pypi
tzdata                    2024.1                   pypi_0    pypi
urllib3                   1.26.19                  pypi_0    pypi
uvicorn                   0.22.0                   pypi_0    pypi
uvloop                    0.20.0                   pypi_0    pypi
virtualenv                20.26.3                  pypi_0    pypi
watchdog                  5.0.0                    pypi_0    pypi
watchfiles                0.24.0                   pypi_0    pypi
watchgod                  0.8.2                    pypi_0    pypi
wcwidth                   0.2.13                   pypi_0    pypi
webencodings              0.5.1                    pypi_0    pypi
websocket-client          1.8.0                    pypi_0    pypi
websockets                13.0                     pypi_0    pypi
werkzeug                  3.0.4                    pypi_0    pypi
wheel                     0.44.0             pyhd8ed1ab_0    conda-forge
widgetsnbextension        4.0.13                   pypi_0    pypi
wrapt                     1.16.0                   pypi_0    pypi
xarray                    2024.7.0                 pypi_0    pypi
xarray-einstats           0.7.0                    pypi_0    pypi
xlsx2csv                  0.8.3                    pypi_0    pypi
xlsxwriter                3.2.0                    pypi_0    pypi
xz                        5.2.6                h166bdaf_0    conda-forge
yarl                      1.9.4                    pypi_0    pypi
zipp                      3.20.1                   pypi_0    pypi
zstd                      1.5.6                ha6fb4c9_0    conda-forge

here is the pip freeze:

adal==1.2.7
adlfs==2023.8.0
aiobotocore==2.5.4
aiofiles==24.1.0
aiohappyeyeballs==2.4.0
aiohttp==3.10.5
aioitertools==0.11.0
aiosignal==1.3.1
antlr4-python3-runtime==4.9.3
anyconfig==0.14.0
anyio==3.7.1
appdirs==1.4.4
applicationinsights==0.11.10
argcomplete==3.3.0
argon2-cffi==23.1.0
argon2-cffi-bindings==21.2.0
arrow==1.3.0
arviz==0.19.0
asttokens==2.4.1
async-timeout==4.0.3
attrs==24.2.0
azure-ai-ml==1.12.1
azure-cli-core==2.63.0
azure-cli-telemetry==1.1.0
azure-common==1.1.28
azure-core==1.30.2
azure-datalake-store==0.0.53
azure-graphrbac==0.61.1
azure-identity==1.17.1
azure-mgmt-authorization==4.0.0
azure-mgmt-containerregistry==10.3.0
azure-mgmt-core==1.4.0
azure-mgmt-keyvault==10.3.1
azure-mgmt-network==26.0.0
azure-mgmt-resource==23.1.1
azure-mgmt-storage==21.2.1
azure-storage-blob==12.22.0
azure-storage-file-datalake==12.16.0
azure-storage-file-share==12.17.0
azureml-core==1.57.0
azureml-dataprep==5.1.6
azureml-dataprep-native==41.0.0
azureml-dataprep-rslex==2.22.3
azureml-fsspec==1.3.1
babel==2.16.0
backports.tempfile==1.0
backports.weakref==1.0.post1
bcrypt==4.2.0
beautifulsoup4==4.12.3
binaryornot==0.4.4
black==22.12.0
bleach==6.1.0
blinker==1.8.2
botocore==1.31.17
build==1.2.1
cachetools==5.5.0
certifi==2024.7.4
cffi==1.17.0
cfgv==3.4.0
chardet==5.2.0
charset-normalizer==3.3.2
click==8.1.7
cloudpickle==2.2.1
colorama==0.4.6
comm==0.2.2
cons==0.4.6
contextlib2==21.6.0
contourpy==1.3.0
cookiecutter==2.6.0
coverage==7.6.1
cryptography==43.0.0
cycler==0.12.1
dash==2.17.1
dash-ag-grid==2.4.0
dash-bootstrap-components==1.6.0
dash-core-components==2.0.0
dash-html-components==2.0.0
dash-table==5.0.0
debugpy==1.8.5
decorator==5.1.1
defusedxml==0.7.1
deltalake==0.19.1
distlib==0.3.8
distro==1.9.0
dm-tree==0.1.8
docker==7.1.0
dynaconf==3.2.6
entrypoints==0.4
et-xmlfile==1.1.0
etuples==0.3.9
evidently==0.4.16
exceptiongroup==1.2.2
executing==2.0.1
Faker==28.0.0
fastapi==0.112.2
fastexcel==0.11.6
fastjsonschema==2.20.0
filelock==3.15.4
flake8==4.0.1
Flask==3.0.3
fonttools==4.53.1
frozenlist==1.4.1
fsspec==2023.5.0
gitdb==4.0.11
GitPython==3.1.43
google-api-core==2.19.2
google-auth==2.34.0
googleapis-common-protos==1.65.0
graphql-core==3.2.3
greenlet==3.0.3
gunicorn==21.2.0
h11==0.14.0
h5netcdf==1.3.0
h5py==3.11.0
httpcore==1.0.5
httptools==0.6.1
httpx==0.27.2
humanfriendly==10.0
identify==2.6.0
idna==3.8
importlib-metadata==6.11.0
importlib_resources==6.4.4
iniconfig==2.0.0
ipykernel==6.29.5
ipython==8.21.0
ipython-genutils==0.2.0
ipywidgets==8.1.5
isodate==0.6.1
isort==5.13.2
iterative-telemetry==0.0.8
itsdangerous==2.2.0
jax==0.4.31
jaxlib==0.4.31
jedi==0.19.1
jeepney==0.8.0
Jinja2==3.1.4
jmespath==1.0.1
joblib==1.4.2
json5==0.9.25
jsonpickle==3.2.2
jsonschema==4.23.0
jsonschema-specifications==2023.12.1
jupyter==1.0.0
jupyter-console==6.6.3
jupyter-server==1.24.0
jupyter_client==7.4.9
jupyter_core==5.7.2
jupyterlab==3.5.3
jupyterlab_pygments==0.3.0
jupyterlab_server==2.15.2
jupyterlab_widgets==3.0.13
kedro==0.18.14
kedro-datasets==2.0.0
kedro-telemetry==0.2.5
kedro-viz==6.7.0
kiwisolver==1.4.5
knack==0.11.0
lazy_loader==0.4
litestar==2.11.0
llvmlite==0.43.0
logical-unification==0.4.6
markdown-it-py==3.0.0
MarkupSafe==2.1.5
marshmallow==3.22.0
matplotlib==3.9.2
matplotlib-inline==0.1.7
mccabe==0.6.1
mdurl==0.1.2
miniKanren==1.0.3
mistune==3.0.2
ml-dtypes==0.4.0
mltable==1.6.1
more-itertools==10.4.0
msal==1.30.0
msal-extensions==1.2.0
msgspec==0.18.6
msrest==0.7.1
msrestazure==0.6.4.post1
multidict==6.0.5
multipledispatch==1.0.0
mypy-extensions==1.0.0
nbclassic==1.1.0
nbclient==0.10.0
nbconvert==7.16.4
nbformat==5.10.4
nbstripout==0.7.1
ndg-httpsclient==0.5.1
nest-asyncio==1.6.0
networkx==3.3
nltk==3.9.1
nodeenv==1.9.1
notebook==6.5.7
notebook_shim==0.2.4
numba==0.60.0
numpy==1.26.4
nutpie==0.13.2
oauthlib==3.2.2
omegaconf==2.3.0
opencensus==0.11.4
opencensus-context==0.1.3
opencensus-ext-azure==1.1.13
openpyxl==3.1.5
opt-einsum==3.3.0
orjson==3.10.7
packaging==23.2
pandas==2.2.2
pandocfilters==1.5.1
paramiko==3.4.1
parse==1.20.2
parso==0.8.4
pathspec==0.12.1
patsy==0.5.6
pexpect==4.9.0
pillow==10.4.0
pip-tools==7.4.1
pkginfo==1.11.1
platformdirs==4.2.2
plotly==5.23.0
pluggy==1.2.0
polars==1.5.0
polyfactory==2.16.2
portalocker==2.10.1
pre-commit==3.8.0
prometheus_client==0.20.0
prompt_toolkit==3.0.47
proto-plus==1.24.0
protobuf==5.27.4
psutil==6.0.0
psycopg2-binary==2.9.9
ptyprocess==0.7.0
pure_eval==0.2.3
pyarrow==16.1.0
pyasn1==0.6.0
pyasn1_modules==0.4.0
pycodestyle==2.8.0
pycparser==2.22
pydantic==1.10.18
pydash==7.0.5
pyflakes==2.4.0
Pygments==2.18.0
PyJWT==2.9.0
pymc==5.15.1
pymc-experimental==0.1.1
PyNaCl==1.5.0
pyodbc==5.1.0
pyOpenSSL==24.2.1
pyparsing==3.1.4
pyproject_hooks==1.1.0
PySocks==1.7.1
pytensor==2.22.1
pytest==7.4.4
pytest-cov==3.0.0
pytest-mock==1.13.0
python-dateutil==2.9.0.post0
python-dotenv==1.0.1
python-slugify==8.0.4
pytoolconfig==1.3.1
pytz==2024.1
PyYAML==6.0.2
pyzmq==26.2.0
qtconsole==5.5.2
QtPy==2.4.1
referencing==0.35.1
regex==2024.7.24
requests==2.32.3
requests-oauthlib==2.0.0
retrying==1.3.4
rich==13.8.0
rich-click==1.8.3
rope==1.13.0
rpds-py==0.20.0
rsa==4.9
s3fs==2023.5.0
scikit-learn==1.5.1
scipy==1.14.1
SecretStorage==3.3.3
secure==0.3.0
Send2Trash==1.8.3
shellingham==1.5.4
six==1.16.0
smmap==5.0.1
sniffio==1.3.1
soupsieve==2.6
SQLAlchemy==2.0.32
stack-data==0.6.3
starlette==0.38.2
statsmodels==0.14.2
strawberry-graphql==0.237.3
strictyaml==1.7.3
tabulate==0.9.0
tenacity==9.0.0
terminado==0.18.1
text-unidecode==1.3
threadpoolctl==3.5.0
tinycss2==1.3.0
toml==0.10.2
tomli==2.0.1
toolz==0.12.1
toposort==1.10
tornado==6.4.1
tqdm==4.66.5
traitlets==5.9.0
typer==0.12.5
types-python-dateutil==2.9.0.20240821
typing-inspect==0.9.0
typing_extensions==4.12.2
tzdata==2024.1
urllib3==1.26.19
uvicorn==0.22.0
uvloop==0.20.0
virtualenv==20.26.3
watchdog==5.0.0
watchfiles==0.24.0
watchgod==0.8.2
wcwidth==0.2.13
webencodings==0.5.1
websocket-client==1.8.0
websockets==13.0
Werkzeug==3.0.4
widgetsnbextension==4.0.13
wrapt==1.16.0
xarray==2024.7.0
xarray-einstats==0.7.0
xlsx2csv==0.8.3
XlsxWriter==3.2.0
yarl==1.9.4
zipp==3.20.1

and the pymc model:

with pm.Model(coords=self.model_coords) as self.model:
            self.model.add_coord("obs_id", self.n_obs)
            self.model.add_coord(
                "fourier_features",
                np.arange(len(self.fourier_features.to_numpy().T)),
            )

            t = pm.Data("t", self.n_obs, dims="obs_id")
            y = pm.Data("y", self.y, dims="obs_id")
            self.t_fut = pm.Data("t_fut", self.n_obs)
            self.ff_fut = pm.Data("ff_fut", self.fourier_features)

            self.coefs = pm.Normal(
                "coefs",
                self.model_config["coefs"]["mu"],
                self.model_config["coefs"]["sigma"],
            )
            self.sigma = pm.HalfNormal("sigma", self.model_config["sigma"])

            init = pm.Normal.dist(
                self.model_config["init"]["mu"],
                self.model_config["init"]["sigma"],
                size=self.model_config["init"]["size"],
            )

            self.ar1 = pm.AR(
                "ar",
                self.coefs,
                sigma=self.sigma,
                init_dist=init,
                constant=True,
                steps=t.shape[0] - (self.model_config["coefs"]["size"] - 1),
                dims="obs_id",
            )

            self.amplitude_trend = pm.HalfNormal("amplitude_trend", 1.0)
            self.ls_trend = pm.HalfNormal("ls_trend", sigma=30)
            self.cov_trend = self.amplitude_trend * pm.gp.cov.ExpQuad(1, self.ls_trend)
            self.gp_trend = pm.gp.HSGP(m=[20], c=2.0, cov_func=self.cov_trend)
            f_trend = self.gp_trend.prior("f_trend", X=t[:, None], dims="obs_id")

            self.beta_fourier = pm.Normal(
                "beta_fourier",
                mu=self.model_config["beta_fourier"]["mu"],
                sigma=self.model_config["beta_fourier"]["sigma"],
                dims="fourier_features",
            )
            fourier_terms = pm.Data("fourier_terms", self.fourier_features.to_numpy().T)
            seasonality = pm.Deterministic(
                "seasonality",
                pm.math.dot(self.beta_fourier, fourier_terms),
                dims="obs_id",
            )

            mu = self.ar1 + f_trend + seasonality

            pm.TruncatedNormal(
                "likelihood",
                mu=mu,
                sigma=self.sigma,
                observed=self.y,
                lower=0,
                dims="obs_id",
            )
maresb commented 1 month ago

Thanks @Dekermanjian for all the extra info!

I'm not sure whether or not this is actually the cause of your problem, but I notice that you mostly have pypi dependencies and only a few conda-forge dependencies. While theoretically this shouldn't be a problem, it's possible that there are weird interactions and conflicts between conda-forge and pypi dependencies.

I'd recommend creating a fresh conda environment containing only the minimal dependencies required to run the model, and install all the dependencies with mamba or conda instead of pip. That would help a lot in terms of narrowing down the problem between nutpie or some quirk in your particular environment.

Dekermanjian commented 1 month ago

@maresb yup, you are correct. From a clean env it works. Now, I just need to figure out where the conflict is arising. Thank you for your help.

Dekermanjian commented 1 month ago

Okay, installing pymc nutpie numba libopenblas and blas with conda conda-forge before installing the other depencies of my project with pip fixed the issue for me.