Closed craigwindell closed 2 years ago
Hi @craigwindell, from your log it looks as though the latest containers for this version may not have been downloaded by Nextflow which might explain this error. I have downloaded the container we released for wf-human-variation-snp
for v0.2.2 and cannot replicate your import error.
Can you check which containers have been downloaded to your Singularity cache dir? You can also try deleting any wf-human-variation images from your Singularity cache dir and starting the workflow again.
Hi @SamStudio8,
singularity cache clean remove Nextflow's cache of images nextflow drop epi2me-labs/wf-human-variation
Same command as before in an empty folder
These are the images freshly pulled by v0.2.2: Pulling Singularity image docker://ontresearch/wf-human-variation-sv:sha04c8557a38dff4f529c859ad55cb2865782802a1 Pulling Singularity image docker://ontresearch/wf-human-variation:sha90e1c9ae1b7cd51548c4c9b66df424fe3c3a81a8 Pulling Singularity image docker://ontresearch/wf-human-variation-snp:shaa215006ce90c5d2ce97352b548400c59a5d0f67a
Same numpy error as before...
-Craig
Hi @craigwindell, thanks for confirming. Those look fine.
I now suspect that you have Python packages in your $HOME that might be automounted to the container by Nextflow and cause a clash with the container environment. Can you add the following lines to your custom Nextflow config and try again?
env {
PYTHONNOUSERSITE = 1
}
Hi @SamStudio8, Bingo! I did have leakage from my home folder into the singularity container.
Thank you for your time helping me diagnose this issue.
Your suggestion solved the problem.
-Craig
Glad that's working for you now! I'll look at mitigating this in future, probably by adding that env block to our standard nextflow.config.
What happened?
snp:pileup_variants fails with python error: RuntimeError: module compiled against API version 0xe but this version of numpy is 0xd RuntimeError: module compiled against API version 0xe but this version of numpy is 0xd ImportError: numpy.core._multiarray_umath failed to import ImportError: numpy.core.umath failed to import
nextflow launch script: cat < nextflow.config
process {
executor = "local"
}
executor {
\$local {
cpus = 48
memory = "128.G"
}
}
singularity {
runOptions = "-B ${TMPDIR}"
}
EOF
OUTPUT='results'
nextflow run epi2me-labs/wf-human-variation -r v0.2.2 \
-resume \
--threads 48 \
-profile singularity \
--snp --sv \
--phase_vcf \
--use_longphase \
--tr_bed demo_data/demo.bed \
--model demo_data/ont_r104_e81_sup_g5015 \
--bam demo_data/demo.bam \
--ref demo_data/demo.fasta \
--out_dir ${OUTPUT}
Environment: HPC with PBS Pro scheduler SUSE12 Singularity: singularity-ce version 3.10.2-1 Nextflow: 22.04.5
With v0.1.1 of the workflow, this error does not occur
Operating System
ubuntu 20.04
Workflow Execution
Command line
Workflow Execution - EPI2ME Labs Versions
No response
Workflow Execution - Execution Profile
Singularity
Workflow Version
v0.2.2
Relevant log output