epi2me-labs / wf-single-cell

Other
70 stars 38 forks source link

ERROR: calc_saturation.py unexpected keyword 'frac' #50

Closed suegrimes closed 1 year ago

suegrimes commented 1 year ago

Operating System

Windows 10

Other Linux

Ubuntu 20.04

Workflow Version

v0.2.7-g9272e2c

Workflow Execution

EPI2ME Desktop application

EPI2ME Version

No response

CLI command run

nextflow run epi2me-labs/wf-single-cell \ -w output/workspace \ -profile local \ --fastq wf-single-cell-demo/chr17.fq.gz \ --kit_name 3prime \ --kit_version v3 \ --expected_cells 100 \ --ref_genome_dir wf-single-cell-demo/ \ --out_dir output \ --plot_umaps

Workflow Execution - CLI Execution Profile

None

What happened?

File "/home/sgrimes/.nextflow/assets/epi2me-labs/wf-single-cell/bin/workflow_glue/calc_saturation.py", line 96, in downsample_dataframe df_scaled = df.sample(frac=fraction) TypeError: sample() got an unexpected keyword argument 'frac'

Relevant log output

Oct-03 15:25:08.847 [main] DEBUG nextflow.cli.Launcher - $> /mnt/ix2/Experimental_tools/nextflow-23.04.3-all run epi2me-labs/wf-single-cell -w output/workspace -profile local --fastq wf-single-cell-demo/chr17.fq.gz --kit_name 3prime --kit_version v3 --expected_cells 100 --ref_genome_dir wf-single-cell-demo/ --out_dir output --plot_umaps
Oct-03 15:25:09.030 [main] INFO  nextflow.cli.CmdRun - N E X T F L O W  ~  version 23.04.3
Oct-03 15:25:09.067 [main] DEBUG nextflow.plugin.PluginsFacade - Setting up plugin manager > mode=prod; embedded=false; plugins-dir=/home/sgrimes/.nextflow/plugins; core-plugins: nf-amazon@1.16.2,nf-azure@1.0.1,nf-codecommit@0.1.4,nf-console@1.0.5,nf-ga4gh@1.0.5,nf-google@1.7.3,nf-tower@1.5.12,nf-wave@0.8.4
Oct-03 15:25:09.093 [main] INFO  org.pf4j.DefaultPluginStatusProvider - Enabled plugins: []
Oct-03 15:25:09.095 [main] INFO  org.pf4j.DefaultPluginStatusProvider - Disabled plugins: []
Oct-03 15:25:09.101 [main] INFO  org.pf4j.DefaultPluginManager - PF4J version 3.4.1 in 'deployment' mode
Oct-03 15:25:09.126 [main] INFO  org.pf4j.AbstractPluginManager - No plugins
Oct-03 15:25:09.155 [main] DEBUG nextflow.scm.ProviderConfig - Using SCM config path: /home/sgrimes/.nextflow/scm
Oct-03 15:25:10.922 [main] DEBUG nextflow.scm.AssetManager - Git config: /home/sgrimes/.nextflow/assets/epi2me-labs/wf-single-cell/.git/config; branch: master; remote: origin; url: https://github.com/epi2me-labs/wf-single-cell.git
Oct-03 15:25:10.966 [main] DEBUG nextflow.scm.RepositoryFactory - Found Git repository result: [RepositoryFactory]
Oct-03 15:25:10.980 [main] DEBUG nextflow.scm.AssetManager - Git config: /home/sgrimes/.nextflow/assets/epi2me-labs/wf-single-cell/.git/config; branch: master; remote: origin; url: https://github.com/epi2me-labs/wf-single-cell.git
Oct-03 15:25:12.020 [main] INFO  nextflow.scm.AssetManager - NOTE: Your local project version looks outdated - a different revision is available in the remote repository [755974f874]
Oct-03 15:25:12.037 [main] DEBUG nextflow.config.ConfigBuilder - Found config base: /home/sgrimes/.nextflow/assets/epi2me-labs/wf-single-cell/nextflow.config
Oct-03 15:25:12.038 [main] DEBUG nextflow.config.ConfigBuilder - Parsing config file: /home/sgrimes/.nextflow/assets/epi2me-labs/wf-single-cell/nextflow.config
Oct-03 15:25:12.057 [main] DEBUG nextflow.config.ConfigBuilder - Applying config profile: `local`
Oct-03 15:25:12.404 [main] DEBUG nextflow.config.ConfigBuilder - Available config profiles: [standard, conda, singularity, awsbatch, local]
Oct-03 15:25:12.463 [main] DEBUG nextflow.cli.CmdRun - Applied DSL=2 from script declararion
Oct-03 15:25:12.465 [main] INFO  nextflow.cli.CmdRun - Launching `https://github.com/epi2me-labs/wf-single-cell` [ecstatic_rosalind] DSL2 - revision: 9272e2ce6d [master]
Oct-03 15:25:12.465 [main] DEBUG nextflow.plugin.PluginsFacade - Plugins default=[]
Oct-03 15:25:12.466 [main] DEBUG nextflow.plugin.PluginsFacade - Plugins resolved requirement=[]
Oct-03 15:25:12.473 [main] DEBUG nextflow.secret.LocalSecretsProvider - Secrets store: /home/sgrimes/.nextflow/secrets/store.json
Oct-03 15:25:12.479 [main] DEBUG nextflow.secret.SecretsLoader - Discovered secrets providers: [nextflow.secret.LocalSecretsProvider@42730828] - activable => nextflow.secret.LocalSecretsProvider@42730828
Oct-03 15:25:12.585 [main] DEBUG nextflow.Session - Session UUID: 1cbbf88c-97de-4c38-a8c3-3e19d4a63029
Oct-03 15:25:12.585 [main] DEBUG nextflow.Session - Run name: ecstatic_rosalind
Oct-03 15:25:12.587 [main] DEBUG nextflow.Session - Executor pool size: 64
Oct-03 15:25:12.607 [main] DEBUG nextflow.util.ThreadPoolBuilder - Creating thread pool 'FileTransfer' minSize=10; maxSize=192; workQueue=LinkedBlockingQueue[10000]; allowCoreThreadTimeout=false
Oct-03 15:25:12.646 [main] DEBUG nextflow.cli.CmdRun - 
  Version: 23.04.3 build 5875
  Created: 11-08-2023 18:37 UTC (11:37 PDT)
  System: Linux 5.4.0-152-generic
  Runtime: Groovy 3.0.16 on OpenJDK 64-Bit Server VM 11.0.20.1+1-post-Ubuntu-0ubuntu120.04
  Encoding: UTF-8 (UTF-8)
  Process: 551881@gari [127.0.1.1]
  CPUs: 64 - Mem: 503.9 GB (471.3 GB) - Swap: 8 GB (8 GB)
Oct-03 15:25:12.688 [main] DEBUG nextflow.Session - Work-dir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace [nfs]
Oct-03 15:25:12.746 [main] DEBUG nextflow.executor.ExecutorFactory - Extension executors providers=[GoogleLifeSciencesExecutor, AwsBatchExecutor, GoogleBatchExecutor]
Oct-03 15:25:12.770 [main] DEBUG nextflow.Session - Observer factory: DefaultObserverFactory
Oct-03 15:25:12.798 [main] DEBUG nextflow.Session - Observer factory: TowerFactory
Oct-03 15:25:12.903 [main] DEBUG nextflow.cache.CacheFactory - Using Nextflow cache factory: nextflow.cache.DefaultCacheFactory
Oct-03 15:25:12.922 [main] DEBUG nextflow.util.CustomThreadPool - Creating default thread pool > poolSize: 65; maxThreads: 1000
Oct-03 15:25:13.013 [main] DEBUG nextflow.Session - Session start
Oct-03 15:25:13.023 [main] DEBUG nextflow.trace.TraceFileObserver - Workflow started -- trace file: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/execution/trace.txt
Oct-03 15:25:13.051 [main] DEBUG nextflow.Session - Using default localLib path: /home/sgrimes/.nextflow/assets/epi2me-labs/wf-single-cell/lib
Oct-03 15:25:13.059 [main] DEBUG nextflow.Session - Adding to the classpath library: /home/sgrimes/.nextflow/assets/epi2me-labs/wf-single-cell/lib
Oct-03 15:25:13.060 [main] DEBUG nextflow.Session - Adding to the classpath library: /home/sgrimes/.nextflow/assets/epi2me-labs/wf-single-cell/lib/nfcore_external_java_deps.jar
Oct-03 15:25:16.301 [main] DEBUG nextflow.script.ScriptRunner - > Launching execution
Oct-03 15:25:19.362 [main] INFO  nextflow.Nextflow - 
||||||||||   _____ ____ ___ ____  __  __ _____      _       _
||||||||||  | ____|  _ \_ _|___ \|  \/  | ____|    | | __ _| |__  ___
|||||       |  _| | |_) | |  __) | |\/| |  _| _____| |/ _` | '_ \/ __|
|||||       | |___|  __/| | / __/| |  | | |__|_____| | (_| | |_) \__ \
||||||||||  |_____|_|  |___|_____|_|  |_|_____|    |_|\__,_|_.__/|___/
||||||||||  wf-single-cell v0.2.7-g9272e2c
--------------------------------------------------------------------------------
Core Nextflow options
  revision        : master
  runName         : ecstatic_rosalind
  launchDir       : /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo
  workDir         : /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace
  projectDir      : /home/sgrimes/.nextflow/assets/epi2me-labs/wf-single-cell
  userName        : sgrimes
  profile         : local
  configFiles     : /home/sgrimes/.nextflow/assets/epi2me-labs/wf-single-cell/nextflow.config

Input Options
  fastq           : wf-single-cell-demo/chr17.fq.gz
  ref_genome_dir  : wf-single-cell-demo/
  kit_config      : /home/sgrimes/.nextflow/assets/epi2me-labs/wf-single-cell/kit_configs.csv
  expected_cells  : 100

Output Options
  plot_umaps      : true

Advanced options
  matrix_min_genes: 200
  umap_plot_genes : /home/sgrimes/.nextflow/assets/epi2me-labs/wf-single-cell/umap_plot_genes.csv

!! Only displaying parameters that differ from the pipeline defaults !!
--------------------------------------------------------------------------------
If you use epi2me-labs/wf-single-cell for your analysis please cite:

* The nf-core framework
  https://doi.org/10.1038/s41587-020-0439-x

--------------------------------------------------------------------------------
This is epi2me-labs/wf-single-cell v0.2.7-g9272e2c.
--------------------------------------------------------------------------------
Oct-03 15:25:20.155 [main] INFO  nextflow.Nextflow - Checking fastq input.
Oct-03 15:25:20.454 [main] DEBUG nextflow.script.ProcessConfig - Config settings `withLabel:wf_common` matches labels `fastq_ingress,wf_common` for process with name fastcat
Oct-03 15:25:20.465 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
Oct-03 15:25:20.465 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Oct-03 15:25:20.474 [main] DEBUG nextflow.executor.Executor - [warm up] executor > local
Oct-03 15:25:20.482 [main] DEBUG n.processor.LocalPollingMonitor - Creating local task monitor for executor 'local' > cpus=8; memory=12 GB; capacity=64; pollInterval=100ms; dumpInterval=5m
Oct-03 15:25:20.638 [main] DEBUG nextflow.script.ProcessConfig - Config settings `withLabel:wf_common` matches labels `fastq_ingress,wf_common` for process with name move_or_compress
Oct-03 15:25:20.639 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
Oct-03 15:25:20.639 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Oct-03 15:25:20.834 [main] DEBUG nextflow.script.ProcessConfig - Config settings `withLabel:singlecell` matches labels `singlecell` for process with name pipeline:getVersions
Oct-03 15:25:20.835 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
Oct-03 15:25:20.836 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Oct-03 15:25:20.842 [main] DEBUG nextflow.script.ProcessConfig - Config settings `withLabel:singlecell` matches labels `singlecell` for process with name pipeline:getParams
Oct-03 15:25:20.842 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
Oct-03 15:25:20.843 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Oct-03 15:25:20.855 [main] DEBUG nextflow.script.ProcessConfig - Config settings `withLabel:singlecell` matches labels `singlecell` for process with name pipeline:summariseCatChunkReads
Oct-03 15:25:20.858 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
Oct-03 15:25:20.858 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Oct-03 15:25:20.896 [main] DEBUG nextflow.script.ProcessConfig - Config settings `withLabel:singlecell` matches labels `singlecell` for process with name pipeline:stranding:call_adapter_scan
Oct-03 15:25:20.898 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
Oct-03 15:25:20.898 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Oct-03 15:25:20.915 [main] DEBUG nextflow.script.ProcessConfig - Config settings `withLabel:singlecell` matches labels `singlecell` for process with name pipeline:stranding:combine_adapter_tables
Oct-03 15:25:20.916 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
Oct-03 15:25:20.916 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Oct-03 15:25:20.926 [main] DEBUG nextflow.script.ProcessConfig - Config settings `withLabel:singlecell` matches labels `singlecell` for process with name pipeline:stranding:summarize_adapter_table
Oct-03 15:25:20.928 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
Oct-03 15:25:20.928 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Oct-03 15:25:20.936 [main] DEBUG nextflow.script.ProcessConfig - Config settings `withLabel:singlecell` matches labels `singlecell` for process with name pipeline:align:call_paftools
Oct-03 15:25:20.937 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
Oct-03 15:25:20.937 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Oct-03 15:25:20.943 [main] DEBUG nextflow.script.ProcessConfig - Config settings `withLabel:singlecell` matches labels `singlecell` for process with name pipeline:align:get_chrom_sizes
Oct-03 15:25:20.943 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
Oct-03 15:25:20.943 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Oct-03 15:25:20.962 [main] DEBUG nextflow.script.ProcessConfig - Config settings `withLabel:singlecell` matches labels `singlecell` for process with name pipeline:align:align_to_ref
Oct-03 15:25:20.964 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
Oct-03 15:25:20.964 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Oct-03 15:25:20.971 [main] DEBUG nextflow.script.ProcessConfig - Config settings `withLabel:singlecell` matches labels `singlecell` for process with name pipeline:process_bams:split_gtf_by_chroms
Oct-03 15:25:20.972 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
Oct-03 15:25:20.972 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Oct-03 15:25:20.990 [main] DEBUG nextflow.script.ProcessConfig - Config settings `withLabel:singlecell` matches labels `singlecell` for process with name pipeline:process_bams:get_contigs
Oct-03 15:25:20.991 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
Oct-03 15:25:20.991 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Oct-03 15:25:21.042 [main] DEBUG nextflow.script.ProcessConfig - Config settings `withLabel:singlecell` matches labels `singlecell` for process with name pipeline:process_bams:extract_barcodes
Oct-03 15:25:21.043 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
Oct-03 15:25:21.043 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Oct-03 15:25:21.054 [main] DEBUG nextflow.script.ProcessConfig - Config settings `withLabel:singlecell` matches labels `singlecell` for process with name pipeline:process_bams:combine_uncorrect_bcs
Oct-03 15:25:21.056 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
Oct-03 15:25:21.056 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Oct-03 15:25:21.102 [main] DEBUG nextflow.script.ProcessConfig - Config settings `withLabel:singlecell` matches labels `singlecell` for process with name pipeline:process_bams:generate_whitelist
Oct-03 15:25:21.105 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
Oct-03 15:25:21.105 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Oct-03 15:25:21.129 [main] DEBUG nextflow.script.ProcessConfig - Config settings `withLabel:singlecell` matches labels `singlecell` for process with name pipeline:process_bams:assign_barcodes
Oct-03 15:25:21.130 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
Oct-03 15:25:21.131 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Oct-03 15:25:21.153 [main] DEBUG nextflow.script.ProcessConfig - Config settings `withLabel:singlecell` matches labels `singlecell` for process with name pipeline:process_bams:stringtie
Oct-03 15:25:21.154 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
Oct-03 15:25:21.154 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Oct-03 15:25:21.161 [main] DEBUG nextflow.script.ProcessConfig - Config settings `withLabel:singlecell` matches labels `singlecell` for process with name pipeline:process_bams:align_to_transcriptome
Oct-03 15:25:21.162 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
Oct-03 15:25:21.162 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Oct-03 15:25:21.172 [main] DEBUG nextflow.script.ProcessConfig - Config settings `withLabel:singlecell` matches labels `singlecell` for process with name pipeline:process_bams:assign_features
Oct-03 15:25:21.172 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
Oct-03 15:25:21.172 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Oct-03 15:25:21.182 [main] DEBUG nextflow.script.ProcessConfig - Config settings `withLabel:singlecell` matches labels `singlecell` for process with name pipeline:process_bams:cluster_umis
Oct-03 15:25:21.183 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
Oct-03 15:25:21.184 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Oct-03 15:25:21.209 [main] DEBUG nextflow.script.ProcessConfig - Config settings `withLabel:singlecell` matches labels `singlecell` for process with name pipeline:process_bams:tag_bams
Oct-03 15:25:21.211 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
Oct-03 15:25:21.211 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Oct-03 15:25:21.219 [main] DEBUG nextflow.script.ProcessConfig - Config settings `withLabel:singlecell` matches labels `singlecell` for process with name pipeline:process_bams:combine_tag_files
Oct-03 15:25:21.220 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
Oct-03 15:25:21.220 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Oct-03 15:25:21.226 [main] DEBUG nextflow.script.ProcessConfig - Config settings `withLabel:singlecell` matches labels `singlecell` for process with name pipeline:process_bams:combine_final_tag_files
Oct-03 15:25:21.226 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
Oct-03 15:25:21.227 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Oct-03 15:25:21.231 [main] DEBUG nextflow.script.ProcessConfig - Config settings `withLabel:singlecell` matches labels `singlecell` for process with name pipeline:process_bams:umi_gene_saturation
Oct-03 15:25:21.232 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
Oct-03 15:25:21.232 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Oct-03 15:25:21.236 [main] DEBUG nextflow.script.ProcessConfig - Config settings `withLabel:singlecell` matches labels `singlecell` for process with name pipeline:process_bams:construct_expression_matrix
Oct-03 15:25:21.237 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
Oct-03 15:25:21.237 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Oct-03 15:25:21.243 [main] DEBUG nextflow.script.ProcessConfig - Config settings `withLabel:singlecell` matches labels `singlecell` for process with name pipeline:process_bams:process_expression_matrix
Oct-03 15:25:21.244 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
Oct-03 15:25:21.244 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Oct-03 15:25:21.254 [main] DEBUG nextflow.script.ProcessConfig - Config settings `withLabel:singlecell` matches labels `singlecell` for process with name pipeline:process_bams:umap_reduce_expression_matrix
Oct-03 15:25:21.254 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
Oct-03 15:25:21.255 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Oct-03 15:25:21.265 [main] DEBUG nextflow.script.ProcessConfig - Config settings `withLabel:singlecell` matches labels `singlecell` for process with name pipeline:process_bams:pack_images
Oct-03 15:25:21.266 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
Oct-03 15:25:21.267 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Oct-03 15:25:21.313 [main] DEBUG nextflow.script.ProcessConfig - Config settings `withLabel:singlecell` matches labels `singlecell` for process with name pipeline:prepare_report_data
Oct-03 15:25:21.314 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
Oct-03 15:25:21.314 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Oct-03 15:25:21.354 [main] DEBUG nextflow.script.ProcessConfig - Config settings `withLabel:singlecell` matches labels `singlecell` for process with name pipeline:makeReport
Oct-03 15:25:21.355 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
Oct-03 15:25:21.356 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Oct-03 15:25:21.371 [main] DEBUG nextflow.script.ProcessConfig - Config settings `withLabel:singlecell` matches labels `singlecell` for process with name output
Oct-03 15:25:21.371 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
Oct-03 15:25:21.372 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Oct-03 15:25:21.375 [main] DEBUG nextflow.script.ProcessConfig - Config settings `withLabel:singlecell` matches labels `singlecell` for process with name output_report
Oct-03 15:25:21.376 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
Oct-03 15:25:21.376 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
Oct-03 15:25:21.379 [main] DEBUG nextflow.Session - Workflow process names [dsl2]: pipeline:getParams, summarize_adapter_table, combine_chrom_bams, pipeline:stranding:summarize_adapter_table, pipeline:process_bams:tag_bams, pipeline:process_bams:combine_final_tag_files, pipeline:process_bams:pack_images, output, pipeline:align:call_paftools, pipeline:process_bams:assign_barcodes, makeReport, get_chrom_sizes, align_to_ref, getVersions, call_paftools, pipeline:process_bams:construct_expression_matrix, combine_final_tag_files, pack_images, combine_tag_files, pipeline:process_bams:extract_barcodes, pipeline:stranding:call_adapter_scan, umap_reduce_expression_matrix, assign_features, construct_expression_matrix, cluster_umis, fastcat, pipeline:prepare_report_data, generate_whitelist, pipeline:process_bams:combine_tag_files, extract_barcodes, pipeline:process_bams:stringtie, getParams, summariseCatChunkReads, prepare_report_data, pipeline:align:align_to_ref, validate_sample_sheet, combine_uncorrect_bcs, process_expression_matrix, pipeline:process_bams:umi_gene_saturation, pipeline:makeReport, pipeline:process_bams:get_contigs, combine_adapter_tables, pipeline:process_bams:split_gtf_by_chroms, assign_barcodes, pipeline:align:get_chrom_sizes, call_adapter_scan, tag_bams, umi_gene_saturation, pipeline:process_bams:generate_whitelist, pipeline:summariseCatChunkReads, pipeline:process_bams:align_to_transcriptome, stringtie, pipeline:process_bams:cluster_umis, pipeline:process_bams:process_expression_matrix, pipeline:getVersions, move_or_compress, pipeline:process_bams:assign_features, pipeline:process_bams:combine_uncorrect_bcs, pipeline:process_bams:umap_reduce_expression_matrix, output_report, get_contigs, align_to_transcriptome, pipeline:stranding:combine_adapter_tables, split_gtf_by_chroms
Oct-03 15:25:21.380 [main] DEBUG nextflow.Session - Igniting dataflow network (37)
Oct-03 15:25:21.380 [main] DEBUG nextflow.processor.TaskProcessor - Starting process > fastcat
Oct-03 15:25:21.381 [main] DEBUG nextflow.processor.TaskProcessor - Starting process > move_or_compress
Oct-03 15:25:21.419 [main] DEBUG nextflow.processor.TaskProcessor - Starting process > pipeline:getVersions
Oct-03 15:25:21.419 [main] DEBUG nextflow.processor.TaskProcessor - Starting process > pipeline:getParams
Oct-03 15:25:21.419 [main] DEBUG nextflow.processor.TaskProcessor - Starting process > pipeline:summariseCatChunkReads
Oct-03 15:25:21.420 [main] DEBUG nextflow.processor.TaskProcessor - Starting process > pipeline:stranding:call_adapter_scan
Oct-03 15:25:21.424 [main] DEBUG nextflow.processor.TaskProcessor - Starting process > pipeline:stranding:combine_adapter_tables
Oct-03 15:25:21.425 [main] DEBUG nextflow.processor.TaskProcessor - Starting process > pipeline:stranding:summarize_adapter_table
Oct-03 15:25:21.428 [main] DEBUG nextflow.processor.TaskProcessor - Starting process > pipeline:align:call_paftools
Oct-03 15:25:21.430 [main] DEBUG nextflow.processor.TaskProcessor - Starting process > pipeline:align:get_chrom_sizes
Oct-03 15:25:21.433 [main] DEBUG nextflow.processor.TaskProcessor - Starting process > pipeline:align:align_to_ref
Oct-03 15:25:21.434 [main] DEBUG nextflow.processor.TaskProcessor - Starting process > pipeline:process_bams:split_gtf_by_chroms
Oct-03 15:25:21.437 [main] DEBUG nextflow.processor.TaskProcessor - Starting process > pipeline:process_bams:get_contigs
Oct-03 15:25:21.438 [main] DEBUG nextflow.processor.TaskProcessor - Starting process > pipeline:process_bams:extract_barcodes
Oct-03 15:25:21.442 [main] DEBUG nextflow.processor.TaskProcessor - Starting process > pipeline:process_bams:combine_uncorrect_bcs
Oct-03 15:25:21.443 [main] DEBUG nextflow.processor.TaskProcessor - Starting process > pipeline:process_bams:generate_whitelist
Oct-03 15:25:21.444 [main] DEBUG nextflow.processor.TaskProcessor - Starting process > pipeline:process_bams:assign_barcodes
Oct-03 15:25:21.445 [main] DEBUG nextflow.processor.TaskProcessor - Starting process > pipeline:process_bams:stringtie
Oct-03 15:25:21.445 [main] DEBUG nextflow.processor.TaskProcessor - Starting process > pipeline:process_bams:align_to_transcriptome
Oct-03 15:25:21.445 [main] DEBUG nextflow.processor.TaskProcessor - Starting process > pipeline:process_bams:assign_features
Oct-03 15:25:21.445 [main] DEBUG nextflow.processor.TaskProcessor - Starting process > pipeline:process_bams:cluster_umis
Oct-03 15:25:21.445 [main] DEBUG nextflow.processor.TaskProcessor - Starting process > pipeline:process_bams:tag_bams
Oct-03 15:25:21.445 [main] DEBUG nextflow.processor.TaskProcessor - Starting process > pipeline:process_bams:combine_tag_files
Oct-03 15:25:21.445 [main] DEBUG nextflow.processor.TaskProcessor - Starting process > pipeline:process_bams:combine_final_tag_files
Oct-03 15:25:21.446 [main] DEBUG nextflow.processor.TaskProcessor - Starting process > pipeline:process_bams:umi_gene_saturation
Oct-03 15:25:21.446 [main] DEBUG nextflow.processor.TaskProcessor - Starting process > pipeline:process_bams:construct_expression_matrix
Oct-03 15:25:21.446 [main] DEBUG nextflow.processor.TaskProcessor - Starting process > pipeline:process_bams:process_expression_matrix
Oct-03 15:25:21.447 [main] DEBUG nextflow.processor.TaskProcessor - Starting process > pipeline:process_bams:umap_reduce_expression_matrix
Oct-03 15:25:21.447 [main] DEBUG nextflow.processor.TaskProcessor - Starting process > pipeline:process_bams:pack_images
Oct-03 15:25:21.447 [main] DEBUG nextflow.processor.TaskProcessor - Starting process > pipeline:prepare_report_data
Oct-03 15:25:21.447 [main] DEBUG nextflow.processor.TaskProcessor - Starting process > pipeline:makeReport
Oct-03 15:25:21.447 [main] DEBUG nextflow.processor.TaskProcessor - Starting process > output
Oct-03 15:25:21.447 [main] DEBUG nextflow.processor.TaskProcessor - Starting process > output_report
Oct-03 15:25:21.448 [main] DEBUG nextflow.script.ScriptRunner - > Awaiting termination 
Oct-03 15:25:21.449 [main] DEBUG nextflow.Session - Session await
Oct-03 15:25:21.893 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Oct-03 15:25:21.903 [Task submitter] INFO  nextflow.Session - [72/ef258e] Submitted process > pipeline:align:get_chrom_sizes
Oct-03 15:25:21.938 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Oct-03 15:25:21.939 [Task submitter] INFO  nextflow.Session - [5d/9df77b] Submitted process > pipeline:process_bams:split_gtf_by_chroms
Oct-03 15:25:21.955 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Oct-03 15:25:21.956 [Task submitter] INFO  nextflow.Session - [7e/0e5d97] Submitted process > pipeline:align:call_paftools
Oct-03 15:25:21.974 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Oct-03 15:25:21.977 [Task submitter] INFO  nextflow.Session - [b3/0efe42] Submitted process > pipeline:getVersions
Oct-03 15:25:21.997 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Oct-03 15:25:21.998 [Task submitter] INFO  nextflow.Session - [e3/ad960d] Submitted process > pipeline:getParams
Oct-03 15:25:22.012 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Oct-03 15:25:22.013 [Task submitter] INFO  nextflow.Session - [8a/04faa5] Submitted process > move_or_compress (1)
Oct-03 15:25:22.193 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 6; name: pipeline:align:get_chrom_sizes; status: COMPLETED; exit: 0; error: -; workDir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/72/ef258e7ded4db3c49acd675723bf5b]
Oct-03 15:25:22.254 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 3; name: pipeline:getParams; status: COMPLETED; exit: 0; error: -; workDir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/e3/ad960d2e1f6c283c1fadbaab08c4ae]
Oct-03 15:25:22.262 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 2; name: move_or_compress (1); status: COMPLETED; exit: 0; error: -; workDir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/8a/04faa544d979965357dc92e36b4cb1]
Oct-03 15:25:22.380 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Oct-03 15:25:22.382 [Task submitter] INFO  nextflow.Session - [a4/a8e0c6] Submitted process > pipeline:summariseCatChunkReads (1)
Oct-03 15:25:22.641 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 1; name: pipeline:process_bams:split_gtf_by_chroms; status: COMPLETED; exit: 0; error: -; workDir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/5d/9df77b2e2676d28431cf18278f3fa1]
Oct-03 15:25:23.383 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 4; name: pipeline:align:call_paftools; status: COMPLETED; exit: 0; error: -; workDir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/7e/0e5d97e72a56175dc6b09035cae98e]
Oct-03 15:25:24.510 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 5; name: pipeline:getVersions; status: COMPLETED; exit: 0; error: -; workDir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/b3/0efe425f331fbda6d323d4e5e83198]
Oct-03 15:25:44.414 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 7; name: pipeline:summariseCatChunkReads (1); status: COMPLETED; exit: 0; error: -; workDir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/a4/a8e0c602f31d7254c981d24e8fb1ca]
Oct-03 15:25:44.480 [Actor Thread 57] DEBUG nextflow.util.CacheHelper - Hash asset file sha-256: /home/sgrimes/.nextflow/assets/epi2me-labs/wf-single-cell/bin/workflow-glue
Oct-03 15:25:44.515 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Oct-03 15:25:44.515 [Task submitter] INFO  nextflow.Session - [6e/589a21] Submitted process > pipeline:stranding:call_adapter_scan (2)
Oct-03 15:25:44.527 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Oct-03 15:25:44.528 [Task submitter] INFO  nextflow.Session - [51/d5afe8] Submitted process > pipeline:stranding:call_adapter_scan (1)
Oct-03 15:25:44.542 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Oct-03 15:25:44.543 [Task submitter] INFO  nextflow.Session - [37/d21e84] Submitted process > pipeline:stranding:call_adapter_scan (3)
Oct-03 15:25:44.552 [Actor Thread 52] DEBUG nextflow.sort.BigSort - Sort completed -- entries: 1; slices: 1; internal sort time: 0.004 s; external sort time: 0.038 s; total time: 0.042 s
Oct-03 15:25:44.558 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Oct-03 15:25:44.559 [Task submitter] INFO  nextflow.Session - [92/465d52] Submitted process > pipeline:stranding:call_adapter_scan (4)
Oct-03 15:25:45.097 [Actor Thread 52] DEBUG nextflow.file.FileCollector - Saved collect-files list to: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/collect-file/b0665e55731a9c0222bd2a108a8e8753
Oct-03 15:25:45.119 [Actor Thread 52] DEBUG nextflow.file.FileCollector - Deleting file collector temp dir: /tmp/nxf-12293914740860742920
Oct-03 15:29:58.596 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 9; name: pipeline:stranding:call_adapter_scan (2); status: COMPLETED; exit: 0; error: -; workDir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/6e/589a21968fc74b4bb40dca1bbfce90]
Oct-03 15:29:59.487 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 10; name: pipeline:stranding:call_adapter_scan (3); status: COMPLETED; exit: 0; error: -; workDir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/37/d21e84ee5a41005b3ce525c96435fc]
Oct-03 15:29:59.901 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 8; name: pipeline:stranding:call_adapter_scan (1); status: COMPLETED; exit: 0; error: -; workDir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/51/d5afe865767b058831717f0e12cf78]
Oct-03 15:30:00.508 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 11; name: pipeline:stranding:call_adapter_scan (4); status: COMPLETED; exit: 0; error: -; workDir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/92/465d527995de2b1677bd85c8c784f9]
Oct-03 15:30:00.567 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Oct-03 15:30:00.568 [Task submitter] INFO  nextflow.Session - [df/cc7f59] Submitted process > pipeline:stranding:combine_adapter_tables (1)
Oct-03 15:30:00.586 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Oct-03 15:30:00.587 [Task submitter] INFO  nextflow.Session - [b2/b45897] Submitted process > pipeline:align:align_to_ref (1)
Oct-03 15:30:01.431 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 13; name: pipeline:stranding:combine_adapter_tables (1); status: COMPLETED; exit: 0; error: -; workDir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/df/cc7f595111b2cb987600abefee8378]
Oct-03 15:30:01.464 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Oct-03 15:30:01.465 [Task submitter] INFO  nextflow.Session - [18/a05865] Submitted process > pipeline:stranding:summarize_adapter_table (1)
Oct-03 15:30:04.349 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 14; name: pipeline:stranding:summarize_adapter_table (1); status: COMPLETED; exit: 0; error: -; workDir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/18/a05865cb64fdb9e34b09d9cb14ec60]
Oct-03 15:30:20.687 [Task monitor] DEBUG n.processor.TaskPollingMonitor - !! executor local > tasks to be completed: 1 -- submitted tasks are shown below
~> TaskHandler[id: 12; name: pipeline:align:align_to_ref (1); status: RUNNING; exit: -; error: -; workDir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/b2/b45897fa625a5e60edc63c3fefe6ed]
Oct-03 15:35:20.708 [Task monitor] DEBUG n.processor.TaskPollingMonitor - !! executor local > tasks to be completed: 1 -- submitted tasks are shown below
~> TaskHandler[id: 12; name: pipeline:align:align_to_ref (1); status: RUNNING; exit: -; error: -; workDir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/b2/b45897fa625a5e60edc63c3fefe6ed]
Oct-03 15:40:20.764 [Task monitor] DEBUG n.processor.TaskPollingMonitor - !! executor local > tasks to be completed: 1 -- submitted tasks are shown below
~> TaskHandler[id: 12; name: pipeline:align:align_to_ref (1); status: RUNNING; exit: -; error: -; workDir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/b2/b45897fa625a5e60edc63c3fefe6ed]
Oct-03 15:41:20.818 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 12; name: pipeline:align:align_to_ref (1); status: COMPLETED; exit: 0; error: -; workDir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/b2/b45897fa625a5e60edc63c3fefe6ed]
Oct-03 15:41:20.868 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Oct-03 15:41:20.869 [Task submitter] INFO  nextflow.Session - [8f/8abfb2] Submitted process > pipeline:process_bams:get_contigs (1)
Oct-03 15:41:20.905 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Oct-03 15:41:20.906 [Task submitter] INFO  nextflow.Session - [2a/6b620b] Submitted process > pipeline:process_bams:stringtie (1)
Oct-03 15:41:21.096 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 15; name: pipeline:process_bams:get_contigs (1); status: COMPLETED; exit: 0; error: -; workDir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/8f/8abfb29d1db7b1e6b0eee288fa76f3]
Oct-03 15:41:21.152 [Actor Thread 64] DEBUG nextflow.util.CacheHelper - Hash asset file sha-256: /home/sgrimes/.nextflow/assets/epi2me-labs/wf-single-cell/data/737K-arc-v1.txt.gz
Oct-03 15:41:21.185 [Actor Thread 64] DEBUG nextflow.util.CacheHelper - Hash asset file sha-256: /home/sgrimes/.nextflow/assets/epi2me-labs/wf-single-cell/data/737K-august-2016.txt.gz
Oct-03 15:41:21.216 [Actor Thread 64] DEBUG nextflow.util.CacheHelper - Hash asset file sha-256: /home/sgrimes/.nextflow/assets/epi2me-labs/wf-single-cell/data/OPTIONAL_FILE
Oct-03 15:41:21.217 [Actor Thread 64] DEBUG nextflow.util.CacheHelper - Hash asset file sha-256: /home/sgrimes/.nextflow/assets/epi2me-labs/wf-single-cell/data/3M-february-2018.txt.gz
Oct-03 15:41:21.462 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Oct-03 15:41:21.463 [Task submitter] INFO  nextflow.Session - [a0/897cdb] Submitted process > pipeline:process_bams:extract_barcodes (1)
Oct-03 15:43:40.252 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 17; name: pipeline:process_bams:extract_barcodes (1); status: COMPLETED; exit: 0; error: -; workDir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/a0/897cdb891e3314b0b3d1408567288c]
Oct-03 15:43:40.290 [Actor Thread 64] DEBUG nextflow.sort.BigSort - Sort completed -- entries: 1; slices: 1; internal sort time: 0.0 s; external sort time: 0.002 s; total time: 0.002 s
Oct-03 15:43:40.296 [Actor Thread 64] DEBUG nextflow.file.FileCollector - Saved collect-files list to: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/collect-file/4d58e49319de74b4560c29f386e00f28
Oct-03 15:43:40.299 [Actor Thread 64] DEBUG nextflow.file.FileCollector - Deleting file collector temp dir: /tmp/nxf-7259401590334209453
Oct-03 15:43:40.322 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Oct-03 15:43:40.323 [Task submitter] INFO  nextflow.Session - [1d/eff5de] Submitted process > pipeline:process_bams:generate_whitelist (1)
Oct-03 15:43:40.367 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Oct-03 15:43:40.368 [Task submitter] INFO  nextflow.Session - [8d/d1e738] Submitted process > pipeline:process_bams:combine_uncorrect_bcs (1)
Oct-03 15:43:41.150 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 18; name: pipeline:process_bams:combine_uncorrect_bcs (1); status: COMPLETED; exit: 0; error: -; workDir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/8d/d1e7383a78b3b287792cf812ebcca7]
Oct-03 15:44:00.577 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 19; name: pipeline:process_bams:generate_whitelist (1); status: COMPLETED; exit: 0; error: -; workDir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/1d/eff5de119c25b2676ee475bde13867]
Oct-03 15:44:00.643 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Oct-03 15:44:00.644 [Task submitter] INFO  nextflow.Session - [a4/addc22] Submitted process > pipeline:process_bams:assign_barcodes (1)
Oct-03 15:44:48.580 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 20; name: pipeline:process_bams:assign_barcodes (1); status: COMPLETED; exit: 0; error: -; workDir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/a4/addc222e4458134e6b2593de2181ee]
Oct-03 15:45:20.847 [Task monitor] DEBUG n.processor.TaskPollingMonitor - !! executor local > tasks to be completed: 1 -- submitted tasks are shown below
~> TaskHandler[id: 16; name: pipeline:process_bams:stringtie (1); status: RUNNING; exit: -; error: -; workDir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/2a/6b620bc9009e349e8e3a395ddce3a2]
Oct-03 15:46:30.123 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 16; name: pipeline:process_bams:stringtie (1); status: COMPLETED; exit: 0; error: -; workDir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/2a/6b620bc9009e349e8e3a395ddce3a2]
Oct-03 15:46:30.148 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Oct-03 15:46:30.149 [Task submitter] INFO  nextflow.Session - [99/c271d4] Submitted process > pipeline:process_bams:align_to_transcriptome (1)
Oct-03 15:50:20.922 [Task monitor] DEBUG n.processor.TaskPollingMonitor - !! executor local > tasks to be completed: 1 -- submitted tasks are shown below
~> TaskHandler[id: 21; name: pipeline:process_bams:align_to_transcriptome (1); status: RUNNING; exit: -; error: -; workDir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/99/c271d4a59767cc05f14b25142be19a]
Oct-03 15:55:20.998 [Task monitor] DEBUG n.processor.TaskPollingMonitor - !! executor local > tasks to be completed: 1 -- submitted tasks are shown below
~> TaskHandler[id: 21; name: pipeline:process_bams:align_to_transcriptome (1); status: RUNNING; exit: -; error: -; workDir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/99/c271d4a59767cc05f14b25142be19a]
Oct-03 15:57:03.175 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 21; name: pipeline:process_bams:align_to_transcriptome (1); status: COMPLETED; exit: 0; error: -; workDir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/99/c271d4a59767cc05f14b25142be19a]
Oct-03 15:57:03.236 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Oct-03 15:57:03.237 [Task submitter] INFO  nextflow.Session - [ba/da5c67] Submitted process > pipeline:process_bams:assign_features (1)
Oct-03 16:00:21.014 [Task monitor] DEBUG n.processor.TaskPollingMonitor - !! executor local > tasks to be completed: 1 -- submitted tasks are shown below
~> TaskHandler[id: 22; name: pipeline:process_bams:assign_features (1); status: RUNNING; exit: -; error: -; workDir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/ba/da5c67ba93ae6c793d65966574a498]
Oct-03 16:05:21.083 [Task monitor] DEBUG n.processor.TaskPollingMonitor - !! executor local > tasks to be completed: 1 -- submitted tasks are shown below
~> TaskHandler[id: 22; name: pipeline:process_bams:assign_features (1); status: RUNNING; exit: -; error: -; workDir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/ba/da5c67ba93ae6c793d65966574a498]
Oct-03 16:10:21.157 [Task monitor] DEBUG n.processor.TaskPollingMonitor - !! executor local > tasks to be completed: 1 -- submitted tasks are shown below
~> TaskHandler[id: 22; name: pipeline:process_bams:assign_features (1); status: RUNNING; exit: -; error: -; workDir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/ba/da5c67ba93ae6c793d65966574a498]
Oct-03 16:13:48.807 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 22; name: pipeline:process_bams:assign_features (1); status: COMPLETED; exit: 0; error: -; workDir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/ba/da5c67ba93ae6c793d65966574a498]
Oct-03 16:13:48.850 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Oct-03 16:13:48.851 [Task submitter] INFO  nextflow.Session - [99/115d9e] Submitted process > pipeline:process_bams:cluster_umis (1)
Oct-03 16:15:21.199 [Task monitor] DEBUG n.processor.TaskPollingMonitor - !! executor local > tasks to be completed: 1 -- submitted tasks are shown below
~> TaskHandler[id: 23; name: pipeline:process_bams:cluster_umis (1); status: RUNNING; exit: -; error: -; workDir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/99/115d9e4be9593cb3a7f0c3c7d9a4a3]
Oct-03 16:16:42.371 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 23; name: pipeline:process_bams:cluster_umis (1); status: COMPLETED; exit: 0; error: -; workDir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/99/115d9e4be9593cb3a7f0c3c7d9a4a3]
Oct-03 16:16:42.397 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Oct-03 16:16:42.398 [Task submitter] INFO  nextflow.Session - [86/a4af90] Submitted process > pipeline:process_bams:combine_final_tag_files (1)
Oct-03 16:16:42.408 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Oct-03 16:16:42.409 [Task submitter] INFO  nextflow.Session - [ac/6f02bb] Submitted process > pipeline:process_bams:combine_tag_files (1)
Oct-03 16:16:42.440 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Oct-03 16:16:42.441 [Task submitter] INFO  nextflow.Session - [39/4310ca] Submitted process > pipeline:process_bams:tag_bams (1)
Oct-03 16:16:43.104 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 24; name: pipeline:process_bams:combine_final_tag_files (1); status: COMPLETED; exit: 0; error: -; workDir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/86/a4af906c924c7ccf7ccb54b529f28a]
Oct-03 16:16:43.159 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 25; name: pipeline:process_bams:combine_tag_files (1); status: COMPLETED; exit: 0; error: -; workDir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/ac/6f02bb23ca90a841477a8646bc7c06]
Oct-03 16:16:43.178 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Oct-03 16:16:43.179 [Task submitter] INFO  nextflow.Session - [8a/cc321f] Submitted process > pipeline:process_bams:construct_expression_matrix (1)
Oct-03 16:16:43.188 [Task submitter] DEBUG n.executor.local.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
Oct-03 16:16:43.188 [Task submitter] INFO  nextflow.Session - [a5/a37b6b] Submitted process > pipeline:process_bams:umi_gene_saturation (1)
Oct-03 16:17:02.757 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 28; name: pipeline:process_bams:umi_gene_saturation (1); status: COMPLETED; exit: 1; error: -; workDir: /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/a5/a37b6b9f4b2ea513e93b847d12a731]
Oct-03 16:17:02.763 [Task monitor] DEBUG nextflow.processor.TaskProcessor - Handling unexpected condition for
  task: name=pipeline:process_bams:umi_gene_saturation (1); work-dir=/mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/a5/a37b6b9f4b2ea513e93b847d12a731
  error [nextflow.exception.ProcessFailedException]: Process `pipeline:process_bams:umi_gene_saturation (1)` terminated with an error exit status (1)
Oct-03 16:17:02.789 [Task monitor] ERROR nextflow.processor.TaskProcessor - Error executing process > 'pipeline:process_bams:umi_gene_saturation (1)'

Caused by:
  Process `pipeline:process_bams:umi_gene_saturation (1)` terminated with an error exit status (1)

Command executed:

  export POLARS_MAX_THREADS=4

  workflow-glue calc_saturation         --output "chr17.saturation_curves.png"         --read_tags read_tags.tsv

Command exit status:
  1

Command output:
  (empty)

Command error:
  [16:17:01 - workflow_glue] Starting entrypoint.
  [16:17:01 - workflow_glue.ClcSat    ] Downsampling reads for saturation curves
  [16:17:01 - workflow_glue.ClcSat    ] Doing 0.01
  Traceback (most recent call last):
    File "/home/sgrimes/.nextflow/assets/epi2me-labs/wf-single-cell/bin/workflow-glue", line 7, in <module>
      cli()
    File "/home/sgrimes/.nextflow/assets/epi2me-labs/wf-single-cell/bin/workflow_glue/__init__.py", line 72, in cli
      args.func(args)
    File "/home/sgrimes/.nextflow/assets/epi2me-labs/wf-single-cell/bin/workflow_glue/calc_saturation.py", line 178, in main
      result = run_jobs(args)
    File "/home/sgrimes/.nextflow/assets/epi2me-labs/wf-single-cell/bin/workflow_glue/calc_saturation.py", line 159, in run_jobs
      records.append(downsample_dataframe(df, frac))
    File "/home/sgrimes/.nextflow/assets/epi2me-labs/wf-single-cell/bin/workflow_glue/calc_saturation.py", line 96, in downsample_dataframe
      df_scaled = df.sample(frac=fraction)
  TypeError: sample() got an unexpected keyword argument 'frac'

Work dir:
  /mnt/ix2/Sandbox/sgrimes/20230911_SG_wf_scell/A01_demo/output/workspace/a5/a37b6b9f4b2ea513e93b847d12a731

Tip: you can try to figure out what's wrong by changing to the process work dir and showing the script file named `.command.sh`
Oct-03 16:17:02.798 [Task monitor] DEBUG nextflow.Session - Session aborted -- Cause: Process `pipeline:process_bams:umi_gene_saturation (1)` terminated with an error exit status (1)
Oct-03 16:17:02.850 [Task monitor] DEBUG nextflow.Session - The following nodes are still active:
[process] pipeline:process_bams:process_expression_matrix
  status=ACTIVE
  port 0: (queue) OPEN  ; channel: -
  port 1: (cntrl) -     ; channel: $

[process] pipeline:process_bams:umap_reduce_expression_matrix
  status=ACTIVE
  port 0: (queue) OPEN  ; channel: -
  port 1: (cntrl) -     ; channel: $

[process] pipeline:prepare_report_data
  status=ACTIVE
  port 0: (queue) OPEN  ; channel: -
  port 1: (cntrl) -     ; channel: $

[process] pipeline:makeReport
  status=ACTIVE
  port 0: (value) bound ; channel: versions
  port 1: (value) bound ; channel: params.csv
  port 2: (queue) OPEN  ; channel: read_stats.csv
  port 3: (queue) OPEN  ; channel: survival.tsv
  port 4: (queue) OPEN  ; channel: wf_summary.tsv
  port 5: (queue) OPEN  ; channel: umap_dirs
  port 6: (value) OPEN  ; channel: images
  port 7: (value) bound ; channel: umap_genes
  port 8: (cntrl) -     ; channel: $

[process] output
  status=ACTIVE
  port 0: (queue) OPEN  ; channel: -
  port 1: (cntrl) -     ; channel: $

[process] output_report
  status=ACTIVE
  port 0: (queue) OPEN  ; channel: fname
  port 1: (cntrl) -     ; channel: $

Application activity log entry

No response

nrhorner commented 1 year ago

Hi @suegrimes

You are running this with a local profile, which we do not support as it's not possible for us to know which versions of dependencies you are using. But I think this is caused by using a new version of Polars. We use 18.1.5 in our docker containers, which you would get using -profile standard or -profile singularity

suegrimes commented 1 year ago

Hi Neil,

Thank you for responding even though I’m doing this in a non-supported way. You’re correct that I have a newer version of polars. I’m trying to set up a condas environment with packages needed, and have polars 0.19.6 installed, so will downgrade that. Is there a way to see what versions of packages are installed in your docker containers? I will try again with singularity later, but wasn’t able to figure out what was going on that was making running under singularity problematic, and we are not able to run with docker. Thanks again,

Sue.

From: Neil Horner @.> Sent: Wednesday, October 4, 2023 1:18 AM To: epi2me-labs/wf-single-cell @.> Cc: Sue M Grimes @.>; Mention @.> Subject: Re: [epi2me-labs/wf-single-cell] ERROR: calc_saturation.py unexpected keyword 'frac' (Issue #50)

Hi @suegrimeshttps://github.com/suegrimes

You are running this with a local profile, which we do not support as it's not possible for us to know which versions of dependencies you are using. But I think this is caused by using a new version of Polars. We use 18.1.5 in our docker containers, which you would get using -profile standard or -profile singularity

— Reply to this email directly, view it on GitHubhttps://github.com/epi2me-labs/wf-single-cell/issues/50#issuecomment-1746370440, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AADNHNN53PBZMX7L25UI4CLX5ULUBAVCNFSM6AAAAAA5RYJD7KVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTONBWGM3TANBUGA. You are receiving this because you were mentioned.Message ID: @.**@.>>