Closed wangguiqian closed 4 months ago
Due to, My computer is LSF System to run,My computer did not connect network.
Hi, did you manage to resolve this? It does look like an issue with the singularity set up on the system you are running it on.
also see https://labs.epi2me.io/singularity/ for guidance
Hi, did you manage to resolve this? It does look like an issue with the singularity set up on the system you are running it on. I am testing much times, But I don’t resolve this. Do you know how did resolve the question ?
also see https://labs.epi2me.io/singularity/ for guidance
I carefully read the link you sent me, but I still can't download the container tools used by singularity, and my server can only run offline. Do you have any other way to solve the problem?
have you tried export NXF_OFFLINE='true'
before running the nextflow cmd above
have you tried
export NXF_OFFLINE='true'
before running the nextflow cmd above Thank you for your answer. I checked the nextflow process later and found that it can be run offline. NXF_OFFLINE='true' But I need to download the image file of pore-c specified singularity before running it. Is that right? Or do I need to download other files? I am still trying to download the image file, but I cannot download this file at the moment. I feel so strange.
Can you download the image to any location? If so then you can specify wherever you have downloaded it to using NXF_SINGULARITY_CACHEDIR=nameofidrectory
and this along with the export NXF_OFFLINE='true' should all you to run it offline. Let me know how it goes.
Can you download the image to any location? If so then you can specify wherever you have downloaded it to using
NXF_SINGULARITY_CACHEDIR=nameofidrectory
and this along with the export NXF_OFFLINE='true' should all you to run it offline. Let me know how it goes.
I now fully understand what you mean, that is, to run this program by downloading the image first. But I am in China, and I don’t know why I can’t download the image singularity pull --name ontresearch-wf-pore-c docker://ontresearch/wf-pore-c:sha3
Can you download the image to any location? If so then you can specify wherever you have downloaded it to using
NXF_SINGULARITY_CACHEDIR=nameofidrectory
and this along with the export NXF_OFFLINE='true' should all you to run it offline. Let me know how it goes.
Thank you very much
I downloaded the image,but get some errs result
(work) [yqming@login01 Pore_data]$ singularity pull --name ontresearch-wf-pore-c-sha3787c234c0cacf66a67fb77da223cc2e1cb0baf0.img.pulling.1719257860451 docker://ontresearch/wf-pore-c:shab20d0656e02c0f4dac3054ae6c0e1f816de2ff90
INFO: Converting OCI blobs to SIF format
INFO: Starting build...
Getting image source signatures
Copying blob 4f4fb700ef54 skipped: already exists
Copying blob 4f4fb700ef54 skipped: already exists
Copying blob 4f4fb700ef54 skipped: already exists
Copying blob 4f4fb700ef54 skipped: already exists
Copying blob 4f4fb700ef54 skipped: already exists
Copying blob 4f4fb700ef54 [--------------------------------------] 0.0b / 0.0b
FATAL: While making image from oci registry: error fetching image to cache: while building SIF from layers: conveyor failed to get: Error initializing source oci:/public/home/yqming/.singularity/cache/blob:5c188ea4969a72d550a610b2dcd23b9ba491dd5b0b314a90628d1e4ab159f2c8: Error reading blob sha256:ca1778b6935686ad781c27472c4668fc61ec3aeb85494f72deb1921892b9d39e: Get "https://production.cloudflare.docker.com/registry-v2/docker/registry/v2/blobs/sha256/ca/ca1778b6935686ad781c27472c4668fc61ec3aeb85494f72deb1921892b9d39e/data?verify=1721135596-R71uIw7PR2Lp5ZKdvabmITlKdsE%3D": dial tcp 31.13.73.169:443: i/o timeout
Can you download the image to any location? If so then you can specify wherever you have downloaded it to using
NXF_SINGULARITY_CACHEDIR=nameofidrectory
and this along with the export NXF_OFFLINE='true' should all you to run it offline. Let me know how it goes.
Hi ,Thank you very much for your help.Just I solved my problem ,I tried many times.I use offonline to run . Finally I use the command: nextflow run ~/Software/wf-pore-c-1.1.0/ --fastq ../raw_data/Pore-C_part2.fq.gz --ref ../Gh_genome.fa --cutter DpnII -c increase_memory.config --threads 60 --paired_end_minimum_distance 100 --paired_end_maximum_distance 200 --chunk_size 10000 --filter_pairs --paired_end --hi_c --out_dir PoreC_part1 -profile singularity -with-singularity '~/Software/wf-pore-c-1.1.0/ontresearch-wf-pore-c-sha3787c234c0cacf66a67fb77da223cc2e1cb0baf0.sif' -with-trace -resume
ah ok thanks for letting us know
ah ok thanks for letting us know
But I personal have a question that to download wfporec.sif 、wf_common.sif and pore_c_py.sif files is very difficult in China. Advised for you,please you put the 3 files on specific path to download. Thank you so much
您好,我也在使用该软件,在下载的过程中出现了问题,请问您是如何解决的该问题的,可以不吝赐教吗?非常感谢。
Operating System
CentOS 7
Other Linux
CentOS 7
Workflow Version
v.23.10.1
Workflow Execution
Command line
EPI2ME Version
No response
CLI command run
bsub -J Pore_C -n 25 -o Pore_C1.out -e Pore_C1.err -q normal "nextflow run ~/Software/wf-pore-c-1.1.0 --fastq ../raw_data/Pore-C_part1.fq.gz --ref ../Gh_genome.fa --cutter DpnII -c increase_memory.config --threads 60 --paired_end_minimum_distance 100 --paired_end_maximum_distance 200 --chunk_size 10000 --filter_pairs --paired_end --hi_c --out_dir PoreC_part1 -profile singularity"
Workflow Execution - CLI Execution Profile
None
What happened?
Sender: LSF System lsfadmin@c05n06 Subject: Job 26222294: in cluster Exited
Job was submitted from host by user in cluster at Tue Jun 25 03:37:27 2024
Job was executed on host(s) <25*c05n06>, in queue , as user in cluster at Tue Jun 25 03:37:27 2024
</public/home/yqming> was used as the home directory.
</public/home/yqming/Work_plate/Cotton_data/Pore_data> was used as the working directory.
Started at Tue Jun 25 03:37:27 2024
Terminated at Tue Jun 25 03:37:53 2024
Results reported at Tue Jun 25 03:37:53 2024
Your job looked like:
LSBATCH: User input
nextflow run ~/Software/wf-pore-c-1.1.0 --fastq ../raw_data/Pore-C_part1.fq.gz --ref ../Gh_genome.fa --cutter DpnII -c increase_memory.config --threads 60 --paired
Exited with exit code 1.
Resource usage summary:
The output (if any) follows:
N E X T F L O W ~ version 23.10.1 Launching
/public/home/yqming/Software/wf-pore-c-1.1.0/main.nf
[cheesy_knuth] DSL2 - revision: cc183d633a|||||||||| _ __ _ __ ____ |||||||||| | ____| _ | | \/ | __| | | | | ||||| | | | |) | | ) | |\/| | _| ___| |/ ` | ' \/ | ||||| | |_| /| | / /| | | | |_|| | (| | |) _ \ |||||||||| |____|_| |_|___|| ||| ||\,|._/|/ |||||||||| wf-pore-c v1.1.0
Core Nextflow options runName : cheesy_knuth containerEngine : singularity container : [withLabel:wfporec:ontresearch/wf-pore-c:sha3787c234c0cacf66a67fb77da223cc2e1cb0baf0, withLabel:pore_c_py:ontresearch/pore-c-py:shad launchDir : /public/home/yqming/Work_plate/Cotton_data/Pore_data workDir : /public/home/yqming/Work_plate/Cotton_data/Pore_data/work ...skipping... [- ] process > POREC:merge_pairs - [- ] process > POREC:merge_pairs_stats - [- ] process > POREC:pair_stats_report - [- ] process > POREC:merge_paired_end_bams - [- ] process > POREC:getVersions - [- ] process > POREC:getParams - [- ] process > POREC:makeReport - [- ] process > POREC:prepare_hic - [- ] process > POREC:get_filtered_out_bam - [- ] process > output - Pulling Singularity image docker://ontresearch/wf-common:sha1c5febff9f75143710826498b093d9769a5edbb9 [cache /public/home/yqming/Work_plate/Cotton_data/Pore_data/wo Pulling Singularity image docker://ontresearch/wf-pore-c:sha3787c234c0cacf66a67fb77da223cc2e1cb0baf0 [cache /public/home/yqming/Work_plate/Cotton_data/Pore_data/wo WARN: Singularity cache directory has not been defined -- Remote image will be stored in the path: /public/home/yqming/Work_plate/Cotton_data/Pore_data/work/singul ERROR ~ Error executing process > 'POREC:getVersions'
Caused by: Failed to pull singularity image command: singularity pull --name ontresearch-wf-pore-c-sha3787c234c0cacf66a67fb77da223cc2e1cb0baf0.img.pulling.1719257860451 docker://ontresearch/wf-pore-c:sha3 status : 255 message: FATAL: While making image from oci registry: error fetching image to cache: failed to get checksum for docker://ontresearch/wf-pore-c:sha3787c234c0cacf66a67f
-- Check '.nextflow.log' file for details
PS:
Read file for stderr output of this job.
Waiting for data... (interrupt to abort)
Relevant log output
Application activity log entry
No response
Were you able to successfully run the latest version of the workflow with the demo data?
other (please describe below)
Other demo data information
No response