Closed alessandro-maverick closed 2 months ago
Hi Alessandro!
My apologies, I updated the code recently, but forgot to fix this section in the README. The major change in the repo is that I made a general nextflow script for all fragfold jobs and use the yaml files in params/
to define the job-specific details. Make sure to pull the newest version of the repo before trying this. If it doesn't run, let me know and I can look into it further.
To get this to run, you will need to set WORKDIR and also edit two lines in the yaml file (protein_query_seq
and experimental_data
are absolute paths to those files on your system, both files are in the repo)
NEXTFLOWDIR=/home/ubuntu/FragFold/nextflow
WORKDIR=? #directory where results will be stored
NF_CFG=${NEXTFLOWDIR}/nextflow.config
PARAMS=${NEXTFLOWDIR}/params/ftsZ_monomeric_example.yaml
nextflow run ${NEXTFLOWDIR}/main.nf -w $WORK_DIR -c $NF_CFG -params-file $PARAMS -resume
Recently I've been running these as batch scripts, this example may be helpful for you: https://github.com/swanss/FragFold/blob/main/scripts/submit/submit_nextflow.sh
First of all, thank you for the prompt response! I know that this response is a lot, but I think I found a couple more problems while running the default example:
Now after following the instructions I get:
Caused by:
Process `process_msa` terminated with an error exit status (1)
Command executed:
python /home/ubuntu/FragFold/fragfold/create_fragment_msa.py --fragment_a3m_input ftsZ.a3m --fragment_ntermres_start 260 --fragment_ntermres_final 264 --fragment_length 30 --protein_a3m_input /home/ubuntu/FragFold/-c/89/7e336efad89f96ab168983e7662c83/mmseqs2_a3m/ftsZ.a3m --protein_ntermres 10 --protein_ctermres 316 --protein_copies 1
Command exit status:
1
Command output:
(empty)
Command error:
Traceback (most recent call last):
File "/home/ubuntu/FragFold/fragfold/create_fragment_msa.py", line 7, in <module>
from fragfold.src.colabfold_create_msa import createIndividualMSAsFullLengthFragment,createIndividualMSAsFullLengthFragmentHeteromeric
ModuleNotFoundError: No module named 'fragfold.src'
And if I activate the fragfold4
environment (the one specified in my nextflow.config) and type
from fragfold.src.colabfold_create_msa import createIndividualMSAsFullLengthFragment,createIndividualMSAsFullLengthFragmentHeteromeric
in the python console, it only works if I'm in the fragfold directory (meaning that it's just using the local python path).
I also noticed that the default installation script doesn't work on a default ubuntu-bash setup. The correct script should be:
#!/bin/bash
source $(conda info --base)/etc/profile.d/conda.sh
conda create -n fragfold4 -c bioconda python==3.9 nextflow -y && \
conda activate fragfold4 && \
pip install . && \
echo "Installation complete"
I can make a PR with this if you would like. (bash doesn't like &&
on a newline by itself, and bash doesn't necessarily load the conda profile on new spawned shells).
I don't have too much experience with pyproject.toml
, so I don't really know what leads to this. I do see the line that says include = ["fragfold","src"]
in the pyproject, however in the full pip install .
output, there isn't one mention of the string src
. (I can provide the full output if you would like)
Please go ahead and provide the full output from your pip install. I'll attempt a fresh reinstall tonight and see if I replicate the error. Again, sorry about the bugs, and thanks a bunch for trying it out and providing detailed feedback!
No problem, I'm very eager to provide any kind of help to the project and can spin up fresh environments very easily.
Here is the full output:
// NOTE: Above here is the first step of the install script, where it's just creating the conda env.
// The line the says: Processing /home/ubuntu/FragFold is the beginning of the pip install output
.
.
.
# To activate this environment, use
#
# $ conda activate fragfold4
#
# To deactivate an active environment, use
#
# $ conda deactivate
Processing /home/ubuntu/FragFold
Installing build dependencies ... done
Getting requirements to build wheel ... done
Preparing metadata (pyproject.toml) ... done
Collecting biopython (from fragfold==0.0.1)
Using cached biopython-1.83-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (13 kB)
Collecting jupyter (from fragfold==0.0.1)
Using cached jupyter-1.0.0-py2.py3-none-any.whl.metadata (995 bytes)
Collecting numpy (from fragfold==0.0.1)
Downloading numpy-2.0.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (60 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 60.9/60.9 kB 5.2 MB/s eta 0:00:00
Collecting pandas (from fragfold==0.0.1)
Downloading pandas-2.2.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (19 kB)
Collecting scipy (from fragfold==0.0.1)
Using cached scipy-1.13.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (60 kB)
Collecting seaborn (from fragfold==0.0.1)
Using cached seaborn-0.13.2-py3-none-any.whl.metadata (5.4 kB)
Collecting notebook (from jupyter->fragfold==0.0.1)
Using cached notebook-7.2.1-py3-none-any.whl.metadata (10 kB)
Collecting qtconsole (from jupyter->fragfold==0.0.1)
Using cached qtconsole-5.5.2-py3-none-any.whl.metadata (5.1 kB)
Collecting jupyter-console (from jupyter->fragfold==0.0.1)
Using cached jupyter_console-6.6.3-py3-none-any.whl.metadata (5.8 kB)
Collecting nbconvert (from jupyter->fragfold==0.0.1)
Using cached nbconvert-7.16.4-py3-none-any.whl.metadata (8.5 kB)
Collecting ipykernel (from jupyter->fragfold==0.0.1)
Using cached ipykernel-6.29.4-py3-none-any.whl.metadata (6.3 kB)
Collecting ipywidgets (from jupyter->fragfold==0.0.1)
Using cached ipywidgets-8.1.3-py3-none-any.whl.metadata (2.4 kB)
Collecting python-dateutil>=2.8.2 (from pandas->fragfold==0.0.1)
Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB)
Collecting pytz>=2020.1 (from pandas->fragfold==0.0.1)
Using cached pytz-2024.1-py2.py3-none-any.whl.metadata (22 kB)
Collecting tzdata>=2022.7 (from pandas->fragfold==0.0.1)
Downloading tzdata-2024.1-py2.py3-none-any.whl.metadata (1.4 kB)
Collecting matplotlib!=3.6.1,>=3.4 (from seaborn->fragfold==0.0.1)
Using cached matplotlib-3.9.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (11 kB)
Collecting contourpy>=1.0.1 (from matplotlib!=3.6.1,>=3.4->seaborn->fragfold==0.0.1)
Using cached contourpy-1.2.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (5.8 kB)
Collecting cycler>=0.10 (from matplotlib!=3.6.1,>=3.4->seaborn->fragfold==0.0.1)
Using cached cycler-0.12.1-py3-none-any.whl.metadata (3.8 kB)
Collecting fonttools>=4.22.0 (from matplotlib!=3.6.1,>=3.4->seaborn->fragfold==0.0.1)
Using cached fonttools-4.53.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (162 kB)
Collecting kiwisolver>=1.3.1 (from matplotlib!=3.6.1,>=3.4->seaborn->fragfold==0.0.1)
Using cached kiwisolver-1.4.5-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl.metadata (6.4 kB)
Collecting packaging>=20.0 (from matplotlib!=3.6.1,>=3.4->seaborn->fragfold==0.0.1)
Using cached packaging-24.1-py3-none-any.whl.metadata (3.2 kB)
Collecting pillow>=8 (from matplotlib!=3.6.1,>=3.4->seaborn->fragfold==0.0.1)
Using cached pillow-10.3.0-cp39-cp39-manylinux_2_28_x86_64.whl.metadata (9.2 kB)
Collecting pyparsing>=2.3.1 (from matplotlib!=3.6.1,>=3.4->seaborn->fragfold==0.0.1)
Using cached pyparsing-3.1.2-py3-none-any.whl.metadata (5.1 kB)
Collecting importlib-resources>=3.2.0 (from matplotlib!=3.6.1,>=3.4->seaborn->fragfold==0.0.1)
Using cached importlib_resources-6.4.0-py3-none-any.whl.metadata (3.9 kB)
Collecting six>=1.5 (from python-dateutil>=2.8.2->pandas->fragfold==0.0.1)
Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB)
Collecting comm>=0.1.1 (from ipykernel->jupyter->fragfold==0.0.1)
Using cached comm-0.2.2-py3-none-any.whl.metadata (3.7 kB)
Collecting debugpy>=1.6.5 (from ipykernel->jupyter->fragfold==0.0.1)
Using cached debugpy-1.8.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (1.1 kB)
Collecting ipython>=7.23.1 (from ipykernel->jupyter->fragfold==0.0.1)
Using cached ipython-8.18.1-py3-none-any.whl.metadata (6.0 kB)
Collecting jupyter-client>=6.1.12 (from ipykernel->jupyter->fragfold==0.0.1)
Using cached jupyter_client-8.6.2-py3-none-any.whl.metadata (8.3 kB)
Collecting jupyter-core!=5.0.*,>=4.12 (from ipykernel->jupyter->fragfold==0.0.1)
Using cached jupyter_core-5.7.2-py3-none-any.whl.metadata (3.4 kB)
Collecting matplotlib-inline>=0.1 (from ipykernel->jupyter->fragfold==0.0.1)
Using cached matplotlib_inline-0.1.7-py3-none-any.whl.metadata (3.9 kB)
Collecting nest-asyncio (from ipykernel->jupyter->fragfold==0.0.1)
Using cached nest_asyncio-1.6.0-py3-none-any.whl.metadata (2.8 kB)
Collecting psutil (from ipykernel->jupyter->fragfold==0.0.1)
Using cached psutil-6.0.0-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (21 kB)
Collecting pyzmq>=24 (from ipykernel->jupyter->fragfold==0.0.1)
Using cached pyzmq-26.0.3-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl.metadata (6.1 kB)
Collecting tornado>=6.1 (from ipykernel->jupyter->fragfold==0.0.1)
Using cached tornado-6.4.1-cp38-abi3-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (2.5 kB)
Collecting traitlets>=5.4.0 (from ipykernel->jupyter->fragfold==0.0.1)
Using cached traitlets-5.14.3-py3-none-any.whl.metadata (10 kB)
Collecting widgetsnbextension~=4.0.11 (from ipywidgets->jupyter->fragfold==0.0.1)
Using cached widgetsnbextension-4.0.11-py3-none-any.whl.metadata (1.6 kB)
Collecting jupyterlab-widgets~=3.0.11 (from ipywidgets->jupyter->fragfold==0.0.1)
Using cached jupyterlab_widgets-3.0.11-py3-none-any.whl.metadata (4.1 kB)
Collecting prompt-toolkit>=3.0.30 (from jupyter-console->jupyter->fragfold==0.0.1)
Using cached prompt_toolkit-3.0.47-py3-none-any.whl.metadata (6.4 kB)
Collecting pygments (from jupyter-console->jupyter->fragfold==0.0.1)
Using cached pygments-2.18.0-py3-none-any.whl.metadata (2.5 kB)
Collecting beautifulsoup4 (from nbconvert->jupyter->fragfold==0.0.1)
Using cached beautifulsoup4-4.12.3-py3-none-any.whl.metadata (3.8 kB)
Collecting bleach!=5.0.0 (from nbconvert->jupyter->fragfold==0.0.1)
Using cached bleach-6.1.0-py3-none-any.whl.metadata (30 kB)
Collecting defusedxml (from nbconvert->jupyter->fragfold==0.0.1)
Using cached defusedxml-0.7.1-py2.py3-none-any.whl.metadata (32 kB)
Collecting importlib-metadata>=3.6 (from nbconvert->jupyter->fragfold==0.0.1)
Using cached importlib_metadata-7.2.1-py3-none-any.whl.metadata (4.6 kB)
Collecting jinja2>=3.0 (from nbconvert->jupyter->fragfold==0.0.1)
Using cached jinja2-3.1.4-py3-none-any.whl.metadata (2.6 kB)
Collecting jupyterlab-pygments (from nbconvert->jupyter->fragfold==0.0.1)
Using cached jupyterlab_pygments-0.3.0-py3-none-any.whl.metadata (4.4 kB)
Collecting markupsafe>=2.0 (from nbconvert->jupyter->fragfold==0.0.1)
Using cached MarkupSafe-2.1.5-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.0 kB)
Collecting mistune<4,>=2.0.3 (from nbconvert->jupyter->fragfold==0.0.1)
Using cached mistune-3.0.2-py3-none-any.whl.metadata (1.7 kB)
Collecting nbclient>=0.5.0 (from nbconvert->jupyter->fragfold==0.0.1)
Using cached nbclient-0.10.0-py3-none-any.whl.metadata (7.8 kB)
Collecting nbformat>=5.7 (from nbconvert->jupyter->fragfold==0.0.1)
Using cached nbformat-5.10.4-py3-none-any.whl.metadata (3.6 kB)
Collecting pandocfilters>=1.4.1 (from nbconvert->jupyter->fragfold==0.0.1)
Using cached pandocfilters-1.5.1-py2.py3-none-any.whl.metadata (9.0 kB)
Collecting tinycss2 (from nbconvert->jupyter->fragfold==0.0.1)
Using cached tinycss2-1.3.0-py3-none-any.whl.metadata (3.0 kB)
Collecting jupyter-server<3,>=2.4.0 (from notebook->jupyter->fragfold==0.0.1)
Using cached jupyter_server-2.14.1-py3-none-any.whl.metadata (8.4 kB)
Collecting jupyterlab-server<3,>=2.27.1 (from notebook->jupyter->fragfold==0.0.1)
Using cached jupyterlab_server-2.27.2-py3-none-any.whl.metadata (5.9 kB)
Collecting jupyterlab<4.3,>=4.2.0 (from notebook->jupyter->fragfold==0.0.1)
Using cached jupyterlab-4.2.2-py3-none-any.whl.metadata (16 kB)
Collecting notebook-shim<0.3,>=0.2 (from notebook->jupyter->fragfold==0.0.1)
Using cached notebook_shim-0.2.4-py3-none-any.whl.metadata (4.0 kB)
Collecting qtpy>=2.4.0 (from qtconsole->jupyter->fragfold==0.0.1)
Using cached QtPy-2.4.1-py3-none-any.whl.metadata (12 kB)
Collecting webencodings (from bleach!=5.0.0->nbconvert->jupyter->fragfold==0.0.1)
Using cached webencodings-0.5.1-py2.py3-none-any.whl.metadata (2.1 kB)
Collecting zipp>=0.5 (from importlib-metadata>=3.6->nbconvert->jupyter->fragfold==0.0.1)
Using cached zipp-3.19.2-py3-none-any.whl.metadata (3.6 kB)
Collecting decorator (from ipython>=7.23.1->ipykernel->jupyter->fragfold==0.0.1)
Using cached decorator-5.1.1-py3-none-any.whl.metadata (4.0 kB)
Collecting jedi>=0.16 (from ipython>=7.23.1->ipykernel->jupyter->fragfold==0.0.1)
Using cached jedi-0.19.1-py2.py3-none-any.whl.metadata (22 kB)
Collecting stack-data (from ipython>=7.23.1->ipykernel->jupyter->fragfold==0.0.1)
Using cached stack_data-0.6.3-py3-none-any.whl.metadata (18 kB)
Collecting typing-extensions (from ipython>=7.23.1->ipykernel->jupyter->fragfold==0.0.1)
Using cached typing_extensions-4.12.2-py3-none-any.whl.metadata (3.0 kB)
Collecting exceptiongroup (from ipython>=7.23.1->ipykernel->jupyter->fragfold==0.0.1)
Using cached exceptiongroup-1.2.1-py3-none-any.whl.metadata (6.6 kB)
Collecting pexpect>4.3 (from ipython>=7.23.1->ipykernel->jupyter->fragfold==0.0.1)
Using cached pexpect-4.9.0-py2.py3-none-any.whl.metadata (2.5 kB)
Collecting platformdirs>=2.5 (from jupyter-core!=5.0.*,>=4.12->ipykernel->jupyter->fragfold==0.0.1)
Using cached platformdirs-4.2.2-py3-none-any.whl.metadata (11 kB)
Collecting anyio>=3.1.0 (from jupyter-server<3,>=2.4.0->notebook->jupyter->fragfold==0.0.1)
Using cached anyio-4.4.0-py3-none-any.whl.metadata (4.6 kB)
Collecting argon2-cffi>=21.1 (from jupyter-server<3,>=2.4.0->notebook->jupyter->fragfold==0.0.1)
Using cached argon2_cffi-23.1.0-py3-none-any.whl.metadata (5.2 kB)
Collecting jupyter-events>=0.9.0 (from jupyter-server<3,>=2.4.0->notebook->jupyter->fragfold==0.0.1)
Using cached jupyter_events-0.10.0-py3-none-any.whl.metadata (5.9 kB)
Collecting jupyter-server-terminals>=0.4.4 (from jupyter-server<3,>=2.4.0->notebook->jupyter->fragfold==0.0.1)
Using cached jupyter_server_terminals-0.5.3-py3-none-any.whl.metadata (5.6 kB)
Collecting overrides>=5.0 (from jupyter-server<3,>=2.4.0->notebook->jupyter->fragfold==0.0.1)
Using cached overrides-7.7.0-py3-none-any.whl.metadata (5.8 kB)
Collecting prometheus-client>=0.9 (from jupyter-server<3,>=2.4.0->notebook->jupyter->fragfold==0.0.1)
Using cached prometheus_client-0.20.0-py3-none-any.whl.metadata (1.8 kB)
Collecting send2trash>=1.8.2 (from jupyter-server<3,>=2.4.0->notebook->jupyter->fragfold==0.0.1)
Using cached Send2Trash-1.8.3-py3-none-any.whl.metadata (4.0 kB)
Collecting terminado>=0.8.3 (from jupyter-server<3,>=2.4.0->notebook->jupyter->fragfold==0.0.1)
Using cached terminado-0.18.1-py3-none-any.whl.metadata (5.8 kB)
Collecting websocket-client>=1.7 (from jupyter-server<3,>=2.4.0->notebook->jupyter->fragfold==0.0.1)
Using cached websocket_client-1.8.0-py3-none-any.whl.metadata (8.0 kB)
Collecting async-lru>=1.0.0 (from jupyterlab<4.3,>=4.2.0->notebook->jupyter->fragfold==0.0.1)
Using cached async_lru-2.0.4-py3-none-any.whl.metadata (4.5 kB)
Collecting httpx>=0.25.0 (from jupyterlab<4.3,>=4.2.0->notebook->jupyter->fragfold==0.0.1)
Using cached httpx-0.27.0-py3-none-any.whl.metadata (7.2 kB)
Collecting jupyter-lsp>=2.0.0 (from jupyterlab<4.3,>=4.2.0->notebook->jupyter->fragfold==0.0.1)
Using cached jupyter_lsp-2.2.5-py3-none-any.whl.metadata (1.8 kB)
Requirement already satisfied: setuptools>=40.1.0 in /home/ubuntu/anaconda3/envs/fragfold4/lib/python3.9/site-packages (from jupyterlab<4.3,>=4.2.0->notebook->jupyter->fragfold==0.0.1) (69.5.1)
Collecting tomli>=1.2.2 (from jupyterlab<4.3,>=4.2.0->notebook->jupyter->fragfold==0.0.1)
Using cached tomli-2.0.1-py3-none-any.whl.metadata (8.9 kB)
Collecting babel>=2.10 (from jupyterlab-server<3,>=2.27.1->notebook->jupyter->fragfold==0.0.1)
Using cached Babel-2.15.0-py3-none-any.whl.metadata (1.5 kB)
Collecting json5>=0.9.0 (from jupyterlab-server<3,>=2.27.1->notebook->jupyter->fragfold==0.0.1)
Using cached json5-0.9.25-py3-none-any.whl.metadata (30 kB)
Collecting jsonschema>=4.18.0 (from jupyterlab-server<3,>=2.27.1->notebook->jupyter->fragfold==0.0.1)
Using cached jsonschema-4.22.0-py3-none-any.whl.metadata (8.2 kB)
Collecting requests>=2.31 (from jupyterlab-server<3,>=2.27.1->notebook->jupyter->fragfold==0.0.1)
Using cached requests-2.32.3-py3-none-any.whl.metadata (4.6 kB)
Collecting fastjsonschema>=2.15 (from nbformat>=5.7->nbconvert->jupyter->fragfold==0.0.1)
Using cached fastjsonschema-2.20.0-py3-none-any.whl.metadata (2.1 kB)
Collecting wcwidth (from prompt-toolkit>=3.0.30->jupyter-console->jupyter->fragfold==0.0.1)
Using cached wcwidth-0.2.13-py2.py3-none-any.whl.metadata (14 kB)
Collecting soupsieve>1.2 (from beautifulsoup4->nbconvert->jupyter->fragfold==0.0.1)
Using cached soupsieve-2.5-py3-none-any.whl.metadata (4.7 kB)
Collecting idna>=2.8 (from anyio>=3.1.0->jupyter-server<3,>=2.4.0->notebook->jupyter->fragfold==0.0.1)
Using cached idna-3.7-py3-none-any.whl.metadata (9.9 kB)
Collecting sniffio>=1.1 (from anyio>=3.1.0->jupyter-server<3,>=2.4.0->notebook->jupyter->fragfold==0.0.1)
Using cached sniffio-1.3.1-py3-none-any.whl.metadata (3.9 kB)
Collecting argon2-cffi-bindings (from argon2-cffi>=21.1->jupyter-server<3,>=2.4.0->notebook->jupyter->fragfold==0.0.1)
Using cached argon2_cffi_bindings-21.2.0-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.7 kB)
Collecting certifi (from httpx>=0.25.0->jupyterlab<4.3,>=4.2.0->notebook->jupyter->fragfold==0.0.1)
Using cached certifi-2024.6.2-py3-none-any.whl.metadata (2.2 kB)
Collecting httpcore==1.* (from httpx>=0.25.0->jupyterlab<4.3,>=4.2.0->notebook->jupyter->fragfold==0.0.1)
Using cached httpcore-1.0.5-py3-none-any.whl.metadata (20 kB)
Collecting h11<0.15,>=0.13 (from httpcore==1.*->httpx>=0.25.0->jupyterlab<4.3,>=4.2.0->notebook->jupyter->fragfold==0.0.1)
Using cached h11-0.14.0-py3-none-any.whl.metadata (8.2 kB)
Collecting parso<0.9.0,>=0.8.3 (from jedi>=0.16->ipython>=7.23.1->ipykernel->jupyter->fragfold==0.0.1)
Using cached parso-0.8.4-py2.py3-none-any.whl.metadata (7.7 kB)
Collecting attrs>=22.2.0 (from jsonschema>=4.18.0->jupyterlab-server<3,>=2.27.1->notebook->jupyter->fragfold==0.0.1)
Using cached attrs-23.2.0-py3-none-any.whl.metadata (9.5 kB)
Collecting jsonschema-specifications>=2023.03.6 (from jsonschema>=4.18.0->jupyterlab-server<3,>=2.27.1->notebook->jupyter->fragfold==0.0.1)
Using cached jsonschema_specifications-2023.12.1-py3-none-any.whl.metadata (3.0 kB)
Collecting referencing>=0.28.4 (from jsonschema>=4.18.0->jupyterlab-server<3,>=2.27.1->notebook->jupyter->fragfold==0.0.1)
Using cached referencing-0.35.1-py3-none-any.whl.metadata (2.8 kB)
Collecting rpds-py>=0.7.1 (from jsonschema>=4.18.0->jupyterlab-server<3,>=2.27.1->notebook->jupyter->fragfold==0.0.1)
Using cached rpds_py-0.18.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.1 kB)
Collecting python-json-logger>=2.0.4 (from jupyter-events>=0.9.0->jupyter-server<3,>=2.4.0->notebook->jupyter->fragfold==0.0.1)
Using cached python_json_logger-2.0.7-py3-none-any.whl.metadata (6.5 kB)
Collecting pyyaml>=5.3 (from jupyter-events>=0.9.0->jupyter-server<3,>=2.4.0->notebook->jupyter->fragfold==0.0.1)
Using cached PyYAML-6.0.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (2.1 kB)
Collecting rfc3339-validator (from jupyter-events>=0.9.0->jupyter-server<3,>=2.4.0->notebook->jupyter->fragfold==0.0.1)
Using cached rfc3339_validator-0.1.4-py2.py3-none-any.whl.metadata (1.5 kB)
Collecting rfc3986-validator>=0.1.1 (from jupyter-events>=0.9.0->jupyter-server<3,>=2.4.0->notebook->jupyter->fragfold==0.0.1)
Using cached rfc3986_validator-0.1.1-py2.py3-none-any.whl.metadata (1.7 kB)
Collecting ptyprocess>=0.5 (from pexpect>4.3->ipython>=7.23.1->ipykernel->jupyter->fragfold==0.0.1)
Using cached ptyprocess-0.7.0-py2.py3-none-any.whl.metadata (1.3 kB)
Collecting charset-normalizer<4,>=2 (from requests>=2.31->jupyterlab-server<3,>=2.27.1->notebook->jupyter->fragfold==0.0.1)
Using cached charset_normalizer-3.3.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (33 kB)
Collecting urllib3<3,>=1.21.1 (from requests>=2.31->jupyterlab-server<3,>=2.27.1->notebook->jupyter->fragfold==0.0.1)
Using cached urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB)
Collecting executing>=1.2.0 (from stack-data->ipython>=7.23.1->ipykernel->jupyter->fragfold==0.0.1)
Using cached executing-2.0.1-py2.py3-none-any.whl.metadata (9.0 kB)
Collecting asttokens>=2.1.0 (from stack-data->ipython>=7.23.1->ipykernel->jupyter->fragfold==0.0.1)
Using cached asttokens-2.4.1-py2.py3-none-any.whl.metadata (5.2 kB)
Collecting pure-eval (from stack-data->ipython>=7.23.1->ipykernel->jupyter->fragfold==0.0.1)
Using cached pure_eval-0.2.2-py3-none-any.whl.metadata (6.2 kB)
Collecting fqdn (from jsonschema[format-nongpl]>=4.18.0->jupyter-events>=0.9.0->jupyter-server<3,>=2.4.0->notebook->jupyter->fragfold==0.0.1)
Using cached fqdn-1.5.1-py3-none-any.whl.metadata (1.4 kB)
Collecting isoduration (from jsonschema[format-nongpl]>=4.18.0->jupyter-events>=0.9.0->jupyter-server<3,>=2.4.0->notebook->jupyter->fragfold==0.0.1)
Using cached isoduration-20.11.0-py3-none-any.whl.metadata (5.7 kB)
Collecting jsonpointer>1.13 (from jsonschema[format-nongpl]>=4.18.0->jupyter-events>=0.9.0->jupyter-server<3,>=2.4.0->notebook->jupyter->fragfold==0.0.1)
Using cached jsonpointer-3.0.0-py2.py3-none-any.whl.metadata (2.3 kB)
Collecting uri-template (from jsonschema[format-nongpl]>=4.18.0->jupyter-events>=0.9.0->jupyter-server<3,>=2.4.0->notebook->jupyter->fragfold==0.0.1)
Using cached uri_template-1.3.0-py3-none-any.whl.metadata (8.8 kB)
Collecting webcolors>=1.11 (from jsonschema[format-nongpl]>=4.18.0->jupyter-events>=0.9.0->jupyter-server<3,>=2.4.0->notebook->jupyter->fragfold==0.0.1)
Using cached webcolors-24.6.0-py3-none-any.whl.metadata (2.6 kB)
Collecting cffi>=1.0.1 (from argon2-cffi-bindings->argon2-cffi>=21.1->jupyter-server<3,>=2.4.0->notebook->jupyter->fragfold==0.0.1)
Using cached cffi-1.16.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (1.5 kB)
Collecting pycparser (from cffi>=1.0.1->argon2-cffi-bindings->argon2-cffi>=21.1->jupyter-server<3,>=2.4.0->notebook->jupyter->fragfold==0.0.1)
Using cached pycparser-2.22-py3-none-any.whl.metadata (943 bytes)
Collecting arrow>=0.15.0 (from isoduration->jsonschema[format-nongpl]>=4.18.0->jupyter-events>=0.9.0->jupyter-server<3,>=2.4.0->notebook->jupyter->fragfold==0.0.1)
Using cached arrow-1.3.0-py3-none-any.whl.metadata (7.5 kB)
Collecting types-python-dateutil>=2.8.10 (from arrow>=0.15.0->isoduration->jsonschema[format-nongpl]>=4.18.0->jupyter-events>=0.9.0->jupyter-server<3,>=2.4.0->notebook->jupyter->fragfold==0.0.1)
Using cached types_python_dateutil-2.9.0.20240316-py3-none-any.whl.metadata (1.8 kB)
Using cached biopython-1.83-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.1 MB)
Using cached jupyter-1.0.0-py2.py3-none-any.whl (2.7 kB)
Downloading numpy-2.0.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (19.3 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19.3/19.3 MB 74.0 MB/s eta 0:00:00
Downloading pandas-2.2.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (13.1 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 13.1/13.1 MB 92.7 MB/s eta 0:00:00
Using cached scipy-1.13.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (38.6 MB)
Using cached seaborn-0.13.2-py3-none-any.whl (294 kB)
Using cached matplotlib-3.9.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (8.3 MB)
Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB)
Using cached pytz-2024.1-py2.py3-none-any.whl (505 kB)
Downloading tzdata-2024.1-py2.py3-none-any.whl (345 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 345.4/345.4 kB 24.1 MB/s eta 0:00:00
Using cached ipykernel-6.29.4-py3-none-any.whl (117 kB)
Using cached ipywidgets-8.1.3-py3-none-any.whl (139 kB)
Using cached jupyter_console-6.6.3-py3-none-any.whl (24 kB)
Using cached nbconvert-7.16.4-py3-none-any.whl (257 kB)
Using cached notebook-7.2.1-py3-none-any.whl (5.0 MB)
Using cached qtconsole-5.5.2-py3-none-any.whl (123 kB)
Using cached bleach-6.1.0-py3-none-any.whl (162 kB)
Using cached comm-0.2.2-py3-none-any.whl (7.2 kB)
Using cached contourpy-1.2.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (304 kB)
Using cached cycler-0.12.1-py3-none-any.whl (8.3 kB)
Using cached debugpy-1.8.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.1 MB)
Using cached fonttools-4.53.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.6 MB)
Using cached importlib_metadata-7.2.1-py3-none-any.whl (25 kB)
Using cached importlib_resources-6.4.0-py3-none-any.whl (38 kB)
Using cached ipython-8.18.1-py3-none-any.whl (808 kB)
Using cached jinja2-3.1.4-py3-none-any.whl (133 kB)
Using cached jupyter_client-8.6.2-py3-none-any.whl (105 kB)
Using cached jupyter_core-5.7.2-py3-none-any.whl (28 kB)
Using cached jupyter_server-2.14.1-py3-none-any.whl (383 kB)
Using cached jupyterlab-4.2.2-py3-none-any.whl (11.6 MB)
Using cached jupyterlab_server-2.27.2-py3-none-any.whl (59 kB)
Using cached jupyterlab_widgets-3.0.11-py3-none-any.whl (214 kB)
Using cached kiwisolver-1.4.5-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (1.6 MB)
Using cached MarkupSafe-2.1.5-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
Using cached matplotlib_inline-0.1.7-py3-none-any.whl (9.9 kB)
Using cached mistune-3.0.2-py3-none-any.whl (47 kB)
Using cached nbclient-0.10.0-py3-none-any.whl (25 kB)
Using cached nbformat-5.10.4-py3-none-any.whl (78 kB)
Using cached notebook_shim-0.2.4-py3-none-any.whl (13 kB)
Using cached packaging-24.1-py3-none-any.whl (53 kB)
Using cached pandocfilters-1.5.1-py2.py3-none-any.whl (8.7 kB)
Using cached pillow-10.3.0-cp39-cp39-manylinux_2_28_x86_64.whl (4.5 MB)
Using cached prompt_toolkit-3.0.47-py3-none-any.whl (386 kB)
Using cached pygments-2.18.0-py3-none-any.whl (1.2 MB)
Using cached pyparsing-3.1.2-py3-none-any.whl (103 kB)
Using cached pyzmq-26.0.3-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (912 kB)
Using cached QtPy-2.4.1-py3-none-any.whl (93 kB)
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Using cached tornado-6.4.1-cp38-abi3-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (436 kB)
Using cached traitlets-5.14.3-py3-none-any.whl (85 kB)
Using cached widgetsnbextension-4.0.11-py3-none-any.whl (2.3 MB)
Using cached beautifulsoup4-4.12.3-py3-none-any.whl (147 kB)
Using cached defusedxml-0.7.1-py2.py3-none-any.whl (25 kB)
Using cached jupyterlab_pygments-0.3.0-py3-none-any.whl (15 kB)
Using cached nest_asyncio-1.6.0-py3-none-any.whl (5.2 kB)
Using cached psutil-6.0.0-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (290 kB)
Using cached tinycss2-1.3.0-py3-none-any.whl (22 kB)
Using cached anyio-4.4.0-py3-none-any.whl (86 kB)
Using cached argon2_cffi-23.1.0-py3-none-any.whl (15 kB)
Using cached async_lru-2.0.4-py3-none-any.whl (6.1 kB)
Using cached Babel-2.15.0-py3-none-any.whl (9.6 MB)
Using cached exceptiongroup-1.2.1-py3-none-any.whl (16 kB)
Using cached fastjsonschema-2.20.0-py3-none-any.whl (23 kB)
Using cached httpx-0.27.0-py3-none-any.whl (75 kB)
Using cached httpcore-1.0.5-py3-none-any.whl (77 kB)
Using cached jedi-0.19.1-py2.py3-none-any.whl (1.6 MB)
Using cached json5-0.9.25-py3-none-any.whl (30 kB)
Using cached jsonschema-4.22.0-py3-none-any.whl (88 kB)
Using cached jupyter_events-0.10.0-py3-none-any.whl (18 kB)
Using cached jupyter_lsp-2.2.5-py3-none-any.whl (69 kB)
Using cached jupyter_server_terminals-0.5.3-py3-none-any.whl (13 kB)
Using cached overrides-7.7.0-py3-none-any.whl (17 kB)
Using cached pexpect-4.9.0-py2.py3-none-any.whl (63 kB)
Using cached platformdirs-4.2.2-py3-none-any.whl (18 kB)
Using cached prometheus_client-0.20.0-py3-none-any.whl (54 kB)
Using cached requests-2.32.3-py3-none-any.whl (64 kB)
Using cached Send2Trash-1.8.3-py3-none-any.whl (18 kB)
Using cached soupsieve-2.5-py3-none-any.whl (36 kB)
Using cached terminado-0.18.1-py3-none-any.whl (14 kB)
Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Using cached typing_extensions-4.12.2-py3-none-any.whl (37 kB)
Using cached webencodings-0.5.1-py2.py3-none-any.whl (11 kB)
Using cached websocket_client-1.8.0-py3-none-any.whl (58 kB)
Using cached zipp-3.19.2-py3-none-any.whl (9.0 kB)
Using cached decorator-5.1.1-py3-none-any.whl (9.1 kB)
Using cached stack_data-0.6.3-py3-none-any.whl (24 kB)
Using cached wcwidth-0.2.13-py2.py3-none-any.whl (34 kB)
Using cached asttokens-2.4.1-py2.py3-none-any.whl (27 kB)
Using cached attrs-23.2.0-py3-none-any.whl (60 kB)
Using cached certifi-2024.6.2-py3-none-any.whl (164 kB)
Using cached charset_normalizer-3.3.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (142 kB)
Using cached executing-2.0.1-py2.py3-none-any.whl (24 kB)
Using cached idna-3.7-py3-none-any.whl (66 kB)
Using cached jsonschema_specifications-2023.12.1-py3-none-any.whl (18 kB)
Using cached parso-0.8.4-py2.py3-none-any.whl (103 kB)
Using cached ptyprocess-0.7.0-py2.py3-none-any.whl (13 kB)
Using cached python_json_logger-2.0.7-py3-none-any.whl (8.1 kB)
Using cached PyYAML-6.0.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (738 kB)
Using cached referencing-0.35.1-py3-none-any.whl (26 kB)
Using cached rfc3986_validator-0.1.1-py2.py3-none-any.whl (4.2 kB)
Using cached rpds_py-0.18.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB)
Using cached sniffio-1.3.1-py3-none-any.whl (10 kB)
Using cached urllib3-2.2.2-py3-none-any.whl (121 kB)
Using cached argon2_cffi_bindings-21.2.0-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (86 kB)
Using cached pure_eval-0.2.2-py3-none-any.whl (11 kB)
Using cached rfc3339_validator-0.1.4-py2.py3-none-any.whl (3.5 kB)
Using cached cffi-1.16.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (443 kB)
Using cached h11-0.14.0-py3-none-any.whl (58 kB)
Using cached jsonpointer-3.0.0-py2.py3-none-any.whl (7.6 kB)
Using cached webcolors-24.6.0-py3-none-any.whl (14 kB)
Using cached fqdn-1.5.1-py3-none-any.whl (9.1 kB)
Using cached isoduration-20.11.0-py3-none-any.whl (11 kB)
Using cached uri_template-1.3.0-py3-none-any.whl (11 kB)
Using cached arrow-1.3.0-py3-none-any.whl (66 kB)
Using cached pycparser-2.22-py3-none-any.whl (117 kB)
Using cached types_python_dateutil-2.9.0.20240316-py3-none-any.whl (9.7 kB)
Building wheels for collected packages: fragfold
Building wheel for fragfold (pyproject.toml) ... done
Created wheel for fragfold: filename=fragfold-0.0.1-py3-none-any.whl size=28331 sha256=a25663eeb7a50899d392b4b45adcc5c164e523a1c468794b49f35041dc076e7d
Stored in directory: /tmp/pip-ephem-wheel-cache-wi66b6ym/wheels/93/9a/a2/e8fa8d1bdd31e8a43cc95d6eb09621f46e31fd1ccf45a7f263
Successfully built fragfold
Installing collected packages: webencodings, wcwidth, pytz, pure-eval, ptyprocess, fastjsonschema, zipp, widgetsnbextension, websocket-client, webcolors, urllib3, uri-template, tzdata, typing-extensions, types-python-dateutil, traitlets, tornado, tomli, tinycss2, soupsieve, sniffio, six, send2trash, rpds-py, rfc3986-validator, pyzmq, pyyaml, python-json-logger, pyparsing, pygments, pycparser, psutil, prompt-toolkit, prometheus-client, platformdirs, pillow, pexpect, parso, pandocfilters, packaging, overrides, numpy, nest-asyncio, mistune, markupsafe, kiwisolver, jupyterlab-widgets, jupyterlab-pygments, jsonpointer, json5, idna, h11, fqdn, fonttools, executing, exceptiongroup, defusedxml, decorator, debugpy, cycler, charset-normalizer, certifi, babel, attrs, terminado, scipy, rfc3339-validator, requests, referencing, qtpy, python-dateutil, matplotlib-inline, jupyter-core, jinja2, jedi, importlib-resources, importlib-metadata, httpcore, contourpy, comm, cffi, bleach, biopython, beautifulsoup4, async-lru, asttokens, anyio, stack-data, pandas, matplotlib, jupyter-server-terminals, jupyter-client, jsonschema-specifications, httpx, arrow, argon2-cffi-bindings, seaborn, jsonschema, isoduration, ipython, argon2-cffi, nbformat, ipywidgets, ipykernel, qtconsole, nbclient, jupyter-events, jupyter-console, nbconvert, jupyter-server, notebook-shim, jupyterlab-server, jupyter-lsp, jupyterlab, notebook, jupyter, fragfold
Successfully installed anyio-4.4.0 argon2-cffi-23.1.0 argon2-cffi-bindings-21.2.0 arrow-1.3.0 asttokens-2.4.1 async-lru-2.0.4 attrs-23.2.0 babel-2.15.0 beautifulsoup4-4.12.3 biopython-1.83 bleach-6.1.0 certifi-2024.6.2 cffi-1.16.0 charset-normalizer-3.3.2 comm-0.2.2 contourpy-1.2.1 cycler-0.12.1 debugpy-1.8.1 decorator-5.1.1 defusedxml-0.7.1 exceptiongroup-1.2.1 executing-2.0.1 fastjsonschema-2.20.0 fonttools-4.53.0 fqdn-1.5.1 fragfold-0.0.1 h11-0.14.0 httpcore-1.0.5 httpx-0.27.0 idna-3.7 importlib-metadata-7.2.1 importlib-resources-6.4.0 ipykernel-6.29.4 ipython-8.18.1 ipywidgets-8.1.3 isoduration-20.11.0 jedi-0.19.1 jinja2-3.1.4 json5-0.9.25 jsonpointer-3.0.0 jsonschema-4.22.0 jsonschema-specifications-2023.12.1 jupyter-1.0.0 jupyter-client-8.6.2 jupyter-console-6.6.3 jupyter-core-5.7.2 jupyter-events-0.10.0 jupyter-lsp-2.2.5 jupyter-server-2.14.1 jupyter-server-terminals-0.5.3 jupyterlab-4.2.2 jupyterlab-pygments-0.3.0 jupyterlab-server-2.27.2 jupyterlab-widgets-3.0.11 kiwisolver-1.4.5 markupsafe-2.1.5 matplotlib-3.9.0 matplotlib-inline-0.1.7 mistune-3.0.2 nbclient-0.10.0 nbconvert-7.16.4 nbformat-5.10.4 nest-asyncio-1.6.0 notebook-7.2.1 notebook-shim-0.2.4 numpy-2.0.0 overrides-7.7.0 packaging-24.1 pandas-2.2.2 pandocfilters-1.5.1 parso-0.8.4 pexpect-4.9.0 pillow-10.3.0 platformdirs-4.2.2 prometheus-client-0.20.0 prompt-toolkit-3.0.47 psutil-6.0.0 ptyprocess-0.7.0 pure-eval-0.2.2 pycparser-2.22 pygments-2.18.0 pyparsing-3.1.2 python-dateutil-2.9.0.post0 python-json-logger-2.0.7 pytz-2024.1 pyyaml-6.0.1 pyzmq-26.0.3 qtconsole-5.5.2 qtpy-2.4.1 referencing-0.35.1 requests-2.32.3 rfc3339-validator-0.1.4 rfc3986-validator-0.1.1 rpds-py-0.18.1 scipy-1.13.1 seaborn-0.13.2 send2trash-1.8.3 six-1.16.0 sniffio-1.3.1 soupsieve-2.5 stack-data-0.6.3 terminado-0.18.1 tinycss2-1.3.0 tomli-2.0.1 tornado-6.4.1 traitlets-5.14.3 types-python-dateutil-2.9.0.20240316 typing-extensions-4.12.2 tzdata-2024.1 uri-template-1.3.0 urllib3-2.2.2 wcwidth-0.2.13 webcolors-24.6.0 webencodings-0.5.1 websocket-client-1.8.0 widgetsnbextension-4.0.11 zipp-3.19.2
Installation complete
Could you please clone this branch, reinstall, and try running the example? https://github.com/swanss/FragFold/tree/fix_install
If you're curious here's some documentation here on finding dependencies in pyproject.toml files. https://setuptools.pypa.io/en/latest/userguide/package_discovery.html#finding-simple-packages
I will admit that while I think these commits fixed the install, it's very difficult to test, because once its been installed successfully, even if I uninstall the package and revert pyproject.toml back to the previous state (where src was not found) and then try reinstalling, it still works (e.g. I can import the packages from within any dir). I tried purging the pip cache and using --no-cache-dir, but that didn't work. If you know more about this I would be curious to hear about it.
Thanks for your help!
(just made one more commit where I change the name of the package to fragfold, instead of fragfold* in the install script)
I figured it out, it was simply that there was no __init__.py
file in fragfold/src
. I added it in this PR
Thanks for adding it! I forgot to track the file when making my commits.
Great! Glad we could figure this out
Please let me know if/when you complete the example! If you run into other problems feel free to open a new issue.
Everything seems to be working now. Unfortunately I'm running into memory limitations with colabfold, but since I'm even getting to that point everything should be working on the FragFold side.
Also just to clarify: my PR was to the fix_install branch. I intended it this way in case you would like to apply more changes, if not it should be merged into master in order for other people to also get the fix.
Have a great day, I'll open a new issue if anything arises.
Okay, since at least the pip-installed package is working for you, I'll go ahead and merge the branch.
Hello, I'm having some trouble running the example fragfold job.
I installed localcolabfold (and tested it), then installed FragFold, no errors there either.
I'm trying to run the example job locally just to test that everything works, however I am not able to do so.
I edited the "General Parameters" as described under
Setting system-specific variables
. Then I replaced all labels for each process withstandard
inFragFold/nextflow/modules.nf
. I then set NEXTFLOWDIR and WORKDIR.It's not very clear where to get the
ftsZ_homomeric_example.nf
file in order to start the job. In my testing I just pointed this to a dummy file to pass the initial check.When looking at the log however, I get:
DEBUG nextflow.Session - Script base path does not exist or is not a directory: /home/ubuntu/FragFold/nextflow/bin
Where
/home/ubuntu/FragFold/nextflow
is $NEXTFLOWDIR (I tried changing it)Any ideas of what I'm doing wrong?