MicrobialDarkMatter / nanomotif

Nanomotif - a tool for identifying methylated motifs in metagenomic samples
MIT License
22 stars 1 forks source link

Fails with specific polars version #53

Closed SorenHeidelbach closed 2 months ago

SorenHeidelbach commented 3 months ago

Nanomotif fails in the postprocessing step on the remove_noisy_motifs. This only occurs for polars version 0.20.26, downgrading to a previous version fixes this error (tested with 0.20.4)

Error message

Traceback (most recent call last):
  File "/home/bio.aau.dk/lx38ll/.conda/envs/nanomotif-dev/bin/nanomotif", line 33, in <module>
    sys.exit(load_entry_point('nanomotif', 'console_scripts', 'nanomotif')())
  File "/home/bio.aau.dk/lx38ll/dark-science/nanomotif/nanomotif/main.py", line 526, in main
    check_install(args)
  File "/home/bio.aau.dk/lx38ll/dark-science/nanomotif/nanomotif/main.py", line 329, in check_install
    motifs = find_motifs(args, pileup=pileup, assembly=assembly)
  File "/home/bio.aau.dk/lx38ll/dark-science/nanomotif/nanomotif/main.py", line 157, in find_motifs
    motifs = nm.postprocess.remove_noisy_motifs(motifs)
  File "/home/bio.aau.dk/lx38ll/dark-science/nanomotif/nanomotif/postprocess.py", line 24, in remove_noisy_motifs
    motif_df_clean = motif_df.filter(col("motif").is_in(clean_motifs))
  File "/home/bio.aau.dk/lx38ll/.conda/envs/nanomotif-dev/lib/python3.9/site-packages/polars/dataframe/frame.py", line 3978, in filter
    return self.lazy().filter(*predicates, **constraints).collect(_eager=True)
  File "/home/bio.aau.dk/lx38ll/.conda/envs/nanomotif-dev/lib/python3.9/site-packages/polars/lazyframe/frame.py", line 1816, in collect
    return wrap_df(ldf.collect(callback))
pyo3_runtime.PanicException: called `Option::unwrap()` on a `None` value

Enviroment

# Name                    Version                   Build  Channel
_libgcc_mutex             0.1                 conda_forge    conda-forge
_openmp_mutex             4.5                       2_gnu    conda-forge
appdirs                   1.4.4                    pypi_0    pypi
asttokens                 2.4.0              pyhd8ed1ab_0    conda-forge
attrs                     23.2.0             pyh71513ae_0    conda-forge
aws-c-auth                0.7.4                h1a24852_6    conda-forge
aws-c-cal                 0.6.7                h6e18cf3_0    conda-forge
aws-c-common              0.9.4                hd590300_0    conda-forge
aws-c-compression         0.2.17               h037bafe_4    conda-forge
aws-c-event-stream        0.3.2                he4fbe49_4    conda-forge
aws-c-http                0.7.13               hbbfb9a7_7    conda-forge
aws-c-io                  0.13.35              hd1885a1_4    conda-forge
aws-c-mqtt                0.9.8                h31a96f8_0    conda-forge
aws-c-s3                  0.3.19               hb128593_1    conda-forge
aws-c-sdkutils            0.1.12               h037bafe_3    conda-forge
aws-checksums             0.1.17               h037bafe_3    conda-forge
aws-crt-cpp               0.24.3               h53d10bb_7    conda-forge
aws-sdk-cpp               1.11.182             h58fcd1b_1    conda-forge
backcall                  0.2.0              pyh9f0ad1d_0    conda-forge
backports                 1.0                pyhd8ed1ab_3    conda-forge
backports.functools_lru_cache 1.6.5              pyhd8ed1ab_0    conda-forge
backports.zoneinfo        0.2.1            py39hf3d152e_8    conda-forge
bio                       1.6.2                    pypi_0    pypi
biopython                 1.83             py39hd1e30aa_0    conda-forge
biothings-client          0.3.1                    pypi_0    pypi
brotli                    1.1.0                hd590300_1    conda-forge
brotli-bin                1.1.0                hd590300_1    conda-forge
bzip2                     1.0.8                h7f98852_4    conda-forge
c-ares                    1.20.1               hd590300_1    conda-forge
ca-certificates           2024.2.2             hbcca054_0    conda-forge
certifi                   2023.7.22                pypi_0    pypi
charset-normalizer        3.3.0                    pypi_0    pypi
click                     8.1.7           unix_pyh707e725_0    conda-forge
colorama                  0.4.6              pyhd8ed1ab_0    conda-forge
comm                      0.1.4              pyhd8ed1ab_0    conda-forge
configargparse            1.7                      pypi_0    pypi
connection-pool           0.0.3                    pypi_0    pypi
contourpy                 1.1.1            py39h7633fee_1    conda-forge
cycler                    0.12.1             pyhd8ed1ab_0    conda-forge
cython                    3.0.7            py39h3d6467e_0    conda-forge
datrie                    0.8.2                    pypi_0    pypi
debugpy                   1.8.0            py39h3d6467e_1    conda-forge
decorator                 5.1.1              pyhd8ed1ab_0    conda-forge
docutils                  0.21.2                   pypi_0    pypi
dpath                     2.1.6                    pypi_0    pypi
exceptiongroup            1.1.3              pyhd8ed1ab_0    conda-forge
executing                 1.2.0              pyhd8ed1ab_0    conda-forge
fastjsonschema            2.19.1                   pypi_0    pypi
fonttools                 4.43.1           py39hd1e30aa_0    conda-forge
freetype                  2.12.1               h267a509_2    conda-forge
gflags                    2.2.2             he1b5a44_1004    conda-forge
gitdb                     4.0.11                   pypi_0    pypi
gitpython                 3.1.43                   pypi_0    pypi
glog                      0.6.0                h6f12383_0    conda-forge
gprofiler-official        1.0.0                    pypi_0    pypi
hdbscan                   0.8.33           py39h44dd56e_4    conda-forge
humanfriendly             10.0                     pypi_0    pypi
hypothesis                6.96.2             pyha770c72_0    conda-forge
icu                       73.2                 h59595ed_0    conda-forge
idna                      3.4                      pypi_0    pypi
importlib-metadata        6.8.0              pyha770c72_0    conda-forge
importlib-resources       6.1.0              pyhd8ed1ab_0    conda-forge
importlib_metadata        6.8.0                hd8ed1ab_0    conda-forge
importlib_resources       6.1.0              pyhd8ed1ab_0    conda-forge
iniconfig                 2.0.0              pyhd8ed1ab_0    conda-forge
ipykernel                 6.25.2             pyh2140261_0    conda-forge
ipython                   8.16.1             pyh0d859eb_0    conda-forge
jedi                      0.19.1             pyhd8ed1ab_0    conda-forge
jinja2                    3.1.3                    pypi_0    pypi
joblib                    1.3.2              pyhd8ed1ab_0    conda-forge
jsonschema                4.22.0                   pypi_0    pypi
jsonschema-specifications 2023.12.1                pypi_0    pypi
jupyter_client            8.4.0              pyhd8ed1ab_0    conda-forge
jupyter_core              5.4.0            py39hf3d152e_0    conda-forge
keyutils                  1.6.1                h166bdaf_0    conda-forge
kiwisolver                1.4.5            py39h7633fee_1    conda-forge
krb5                      1.21.2               h659d440_0    conda-forge
lcms2                     2.15                 h7f713cb_2    conda-forge
ld_impl_linux-64          2.40                 h41732ed_0    conda-forge
lerc                      4.0.0                h27087fc_0    conda-forge
libabseil                 20230802.1      cxx17_h59595ed_0    conda-forge
libarrow                  13.0.0          he1fec18_11_cpu    conda-forge
libblas                   3.9.0           19_linux64_openblas    conda-forge
libbrotlicommon           1.1.0                hd590300_1    conda-forge
libbrotlidec              1.1.0                hd590300_1    conda-forge
libbrotlienc              1.1.0                hd590300_1    conda-forge
libcblas                  3.9.0           19_linux64_openblas    conda-forge
libcrc32c                 1.1.2                h9c3ff4c_0    conda-forge
libcurl                   8.4.0                hca28451_0    conda-forge
libdeflate                1.18                 h0b41bf4_0    conda-forge
libedit                   3.1.20191231         he28a2e2_2    conda-forge
libev                     4.33                 h516909a_1    conda-forge
libevent                  2.1.12               hf998b51_1    conda-forge
libffi                    3.4.2                h7f98852_5    conda-forge
libgcc-ng                 13.2.0               h807b86a_2    conda-forge
libgfortran-ng            13.2.0               h69a702a_2    conda-forge
libgfortran5              13.2.0               ha4646dd_2    conda-forge
libgomp                   13.2.0               h807b86a_2    conda-forge
libgoogle-cloud           2.12.0               h19a6dae_3    conda-forge
libgrpc                   1.58.1               he06187c_2    conda-forge
libhwloc                  2.9.3           default_h554bfaf_1009    conda-forge
libiconv                  1.17                 hd590300_2    conda-forge
libjpeg-turbo             2.1.5.1              hd590300_1    conda-forge
liblapack                 3.9.0           19_linux64_openblas    conda-forge
libllvm14                 14.0.6               hcd5def8_4    conda-forge
libnghttp2                1.52.0               h61bc06f_0    conda-forge
libnsl                    2.0.1                hd590300_0    conda-forge
libnuma                   2.0.16               h0b41bf4_1    conda-forge
libopenblas               0.3.24          pthreads_h413a1c8_0    conda-forge
libpng                    1.6.39               h753d276_0    conda-forge
libprotobuf               4.24.3               hf27288f_1    conda-forge
libre2-11                 2023.06.02           h7a70373_0    conda-forge
libsodium                 1.0.18               h36c2ea0_1    conda-forge
libsqlite                 3.43.2               h2797004_0    conda-forge
libssh2                   1.11.0               h0841786_0    conda-forge
libstdcxx-ng              13.2.0               h7e041cc_2    conda-forge
libthrift                 0.19.0               hb90f79a_1    conda-forge
libtiff                   4.6.0                h8b53f26_0    conda-forge
libutf8proc               2.8.0                h166bdaf_0    conda-forge
libuuid                   2.38.1               h0b41bf4_0    conda-forge
libwebp-base              1.3.2                hd590300_0    conda-forge
libxcb                    1.15                 h0b41bf4_0    conda-forge
libxml2                   2.11.6               h232c23b_0    conda-forge
libzlib                   1.2.13               hd590300_5    conda-forge
llvmlite                  0.41.1           py39h174d805_0    conda-forge
lz4-c                     1.9.4                hcb278e6_0    conda-forge
markupsafe                2.1.5                    pypi_0    pypi
matplotlib-base           3.8.0            py39he9076e7_2    conda-forge
matplotlib-inline         0.1.6              pyhd8ed1ab_0    conda-forge
mizani                    0.9.3              pyhd8ed1ab_0    conda-forge
munkres                   1.1.4              pyh9f0ad1d_0    conda-forge
mygene                    3.2.2                    pypi_0    pypi
nanomotif                 0.4.5                     dev_0    <develop>
nbformat                  5.10.4                   pypi_0    pypi
ncurses                   6.4                  hcb278e6_0    conda-forge
nest-asyncio              1.5.8              pyhd8ed1ab_0    conda-forge
networkx                  3.1                      pypi_0    pypi
numba                     0.58.1           py39h615d6bd_0    conda-forge
numpy                     1.24.4                   pypi_0    pypi
openjpeg                  2.5.0                h488ebb8_3    conda-forge
openssl                   3.3.0                hd590300_0    conda-forge
orc                       1.9.0                h208142c_3    conda-forge
packaging                 23.2               pyhd8ed1ab_0    conda-forge
pandas                    2.0.2                    pypi_0    pypi
parso                     0.8.3              pyhd8ed1ab_0    conda-forge
patsy                     0.5.3              pyhd8ed1ab_0    conda-forge
pexpect                   4.8.0              pyh1a96a4e_2    conda-forge
pickleshare               0.7.5                   py_1003    conda-forge
pillow                    10.0.1           py39h444a776_1    conda-forge
pip                       23.3               pyhd8ed1ab_0    conda-forge
plac                      1.4.3                    pypi_0    pypi
platformdirs              3.11.0             pyhd8ed1ab_0    conda-forge
plotnine                  0.12.3             pyhd8ed1ab_0    conda-forge
pluggy                    1.3.0              pyhd8ed1ab_0    conda-forge
polars                    0.20.26                  pypi_0    pypi
pooch                     1.8.1                    pypi_0    pypi
progressbar2              3.53.1                   pypi_0    pypi
prompt-toolkit            3.0.39             pyha770c72_0    conda-forge
prompt_toolkit            3.0.39               hd8ed1ab_0    conda-forge
psutil                    5.9.5            py39hd1e30aa_1    conda-forge
pthread-stubs             0.4               h36c2ea0_1001    conda-forge
ptyprocess                0.7.0              pyhd3deb0d_0    conda-forge
pulp                      2.8.0                    pypi_0    pypi
pure_eval                 0.2.2              pyhd8ed1ab_0    conda-forge
pyarrow                   16.0.0                   pypi_0    pypi
pygments                  2.16.1             pyhd8ed1ab_0    conda-forge
pynndescent               0.5.11             pyhca7485f_0    conda-forge
pyparsing                 3.1.1              pyhd8ed1ab_0    conda-forge
pysam                     0.22.0           py39hcada746_0    bioconda
pytest                    7.4.4              pyhd8ed1ab_0    conda-forge
python                    3.9.18          h0755675_0_cpython    conda-forge
python-dateutil           2.8.2              pyhd8ed1ab_0    conda-forge
python-tzdata             2023.3             pyhd8ed1ab_0    conda-forge
python-utils              3.8.1              pyhd8ed1ab_0    conda-forge
python_abi                3.9                      4_cp39    conda-forge
pytz                      2023.3.post1       pyhd8ed1ab_0    conda-forge
pyyaml                    6.0.1                    pypi_0    pypi
pyzmq                     25.1.1           py39hb257651_1    conda-forge
rdma-core                 28.9                 h59595ed_1    conda-forge
re2                       2023.06.02           h2873b5e_0    conda-forge
readline                  8.2                  h8228510_1    conda-forge
referencing               0.35.0                   pypi_0    pypi
requests                  2.31.0                   pypi_0    pypi
reretry                   0.11.8                   pypi_0    pypi
rpds-py                   0.18.0                   pypi_0    pypi
s2n                       1.3.55               h06160fa_0    conda-forge
scikit-learn              1.3.2            py39ha22ef79_2    conda-forge
scipy                     1.10.1                   pypi_0    pypi
seaborn                   0.12.2                   pypi_0    pypi
setuptools                68.2.2             pyhd8ed1ab_0    conda-forge
six                       1.16.0             pyh6c4a22f_0    conda-forge
smart-open                7.0.4                    pypi_0    pypi
smmap                     5.0.1                    pypi_0    pypi
snakemake                 7.32.4                   pypi_0    pypi
snappy                    1.1.10               h9fff704_0    conda-forge
sortedcontainers          2.4.0              pyhd8ed1ab_0    conda-forge
stack_data                0.6.2              pyhd8ed1ab_0    conda-forge
statsmodels               0.14.0           py39h44dd56e_2    conda-forge
stopit                    1.1.2                    pypi_0    pypi
tabulate                  0.9.0                    pypi_0    pypi
tbb                       2021.11.0            h00ab1b0_0    conda-forge
threadpoolctl             3.2.0              pyha21a80b_0    conda-forge
throttler                 1.2.2                    pypi_0    pypi
tk                        8.6.13               h2797004_0    conda-forge
tomli                     2.0.1              pyhd8ed1ab_0    conda-forge
toposort                  1.10                     pypi_0    pypi
tornado                   6.3.3            py39hd1e30aa_1    conda-forge
tqdm                      4.66.1             pyhd8ed1ab_0    conda-forge
traitlets                 5.11.2             pyhd8ed1ab_0    conda-forge
typing-extensions         4.8.0                hd8ed1ab_0    conda-forge
typing_extensions         4.8.0              pyha770c72_0    conda-forge
tzdata                    2023c                h71feb2d_0    conda-forge
ucx                       1.15.0               h64cca9d_0    conda-forge
umap-learn                0.5.5            py39hf3d152e_0    conda-forge
unicodedata2              15.1.0           py39hd1e30aa_0    conda-forge
urllib3                   2.0.7                    pypi_0    pypi
wcwidth                   0.2.8              pyhd8ed1ab_0    conda-forge
wheel                     0.41.2             pyhd8ed1ab_0    conda-forge
wrapt                     1.16.0                   pypi_0    pypi
xorg-libxau               1.0.11               hd590300_0    conda-forge
xorg-libxdmcp             1.1.3                h7f98852_0    conda-forge
xz                        5.2.6                h166bdaf_0    conda-forge
yte                       1.5.4                    pypi_0    pypi
zeromq                    4.3.5                h59595ed_0    conda-forge
zipp                      3.17.0             pyhd8ed1ab_0    conda-forge
zlib                      1.2.13               hd590300_5    conda-forge
zstd                      1.5.5                hfc55251_0    conda-forge