search

nextflow-io / nextflow

A DSL for data-driven computational pipelines
http://nextflow.io
Apache License 2.0
2.68k stars 621 forks source link

Nextflow not terminating after all tasks completed #2693

Open mebbert opened 2 years ago

mebbert commented 2 years ago

Bug report

Hello, I submitted a Nextflow workflow to our cluster (SLURM scheduler), but Nextflow did not terminate after all tasks were completed. It eventually timed out because of the SLURM time constraint. Steve on bioinformatics.stackexchange.com thinks it may be related to the errorStrategy 'ignore' I added to all of the tasks.

Expected behavior and actual behavior

I expected Nextflow to terminate on its own after completing all tasks.

Steps to reproduce the problem

This is all based on code in my GitHub repository to test .bam sorting algorithms: Samtools_sort_optimization_test. It seems to be reproducible in my environment.

Program output

The .nextflow.log (attached) ends with hundreds of No more task to compute -- Execution may be stalled statements

nextflow.log.de_identified.txt

Environment

bentsherman commented 2 years ago

I have had this problem as well, and I also think it had something to do with the fact that I was using errorStrategy = 'ignore'. My theory is that when some tasks fail and there are downstream processes, the failed tasks get ignored and the downstream processes get left hanging somehow.

Lehmann-Fabian commented 2 years ago

I think this problem was related to my PR (https://github.com/nextflow-io/nextflow/pull/2787) and should be fixed in the newest Nextflow version.

chasemc commented 2 years ago

Not sure if it's the same but I've started suddenly having this as well (Everything finishes succesfully but then the process hangs on completion)

The last bit of the log file:

Sep-06 11:01:12.261 [main] DEBUG nextflow.Session - Session await > all process finished
Sep-06 11:01:12.262 [main] DEBUG nextflow.Session - Session await > all barriers passed
Sep-06 11:03:21.172 [SIGINT handler] DEBUG nextflow.Session - Session aborted -- Cause: SIGINT
Sep-06 11:03:21.181 [SIGINT handler] DEBUG nextflow.Session - The following nodes are still active:
  [operator] buffer

Sep-06 11:03:21.195 [main] INFO  nextflow.Nextflow - -[socialgene/sgnf] Pipeline completed with errors-
Sep-06 11:03:21.195 [main] INFO  nextflow.Nextflow - -[socialgene/sgnf] Pipeline completed with errors-
Sep-06 11:03:21.197 [main] DEBUG nextflow.trace.WorkflowStatsObserver - Workflow completed > WorkflowStats[succeededCount=60; failedCount=0; ignoredCount=0; cachedCount=0; pendingCount=0; submittedCount=0; runningCount=0; retriesCount=0; abortedCount=0; succeedDuration=9m 12s; failedDuration=0ms; cachedDuration=0ms;loadCpus=0; loadMemory=0; peakRunning=23; peakCpus=24; peakMemory=204.8 MB; ]
Sep-06 11:03:21.198 [main] DEBUG nextflow.trace.TraceFileObserver - Flow completing -- flushing trace file
Sep-06 11:03:21.198 [main] DEBUG nextflow.trace.ReportObserver - Flow completing -- rendering html report
Sep-06 11:03:21.250 [main] DEBUG nextflow.trace.ReportObserver - Execution report summary data:
  [{"cpuUsage":{"mean":22.08,"min":22.08,"q1":22.08,"q2":22.08,"q3":22.08,"max":22.08,"minLabel":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS","maxLabel":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS","q1Label":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS","q2Label":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS","q3Label":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS"},"process":"NEO4J_HEADERS","mem":{"mean":12107776,"min":12107776,"q1":12107776,"q2":12107776,"q3":12107776,"max":12107776,"minLabel":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS","maxLabel":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS","q1Label":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS","q2Label":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS","q3Label":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS"},"memUsage":{"mean":151347200,"min":151347200,"q1":151347200,"q2":151347200,"q3":151347200,"max":151347200,"minLabel":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS","maxLabel":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS","q1Label":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS","q2Label":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS","q3Label":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS"},"timeUsage":null,"vmem":{"mean":18190336,"min":18190336,"q1":18190336,"q2":18190336,"q3":18190336,"max":18190336,"minLabel":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS","maxLabel":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS","q1Label":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS","q2Label":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS","q3Label":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS"},"reads":{"mean":3971314,"min":3971314,"q1":3971314,"q2":3971314,"q3":3971314,"max":3971314,"minLabel":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS","maxLabel":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS","q1Label":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS","q2Label":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS","q3Label":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS"},"cpu":{"mean":88.3,"min":88.3,"q1":88.3,"q2":88.3,"q3":88.3,"max":88.3,"minLabel":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS","maxLabel":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS","q1Label":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS","q2Label":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS","q3Label":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS"},"time":{"mean":200,"min":200,"q1":200,"q2":200,"q3":200,"max":200,"minLabel":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS","maxLabel":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS","q1Label":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS","q2Label":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS","q3Label":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS"},"writes":{"mean":6215,"min":6215,"q1":6215,"q2":6215,"q3":6215,"max":6215,"minLabel":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS","maxLabel":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS","q1Label":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS","q2Label":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS","q3Label":"SOCIALGENE:DB_CREATOR:NEO4J_HEADERS"}},{"cpuUsage":{"mean":21.38,"min":21.38,"q1":21.38,"q2":21.38,"q3":21.38,"max":21.38,"minLabel":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J","maxLabel":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J","q1Label":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J","q2Label":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J","q3Label":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J"},"process":"PARAMETER_EXPORT_FOR_NEO4J","mem":{"mean":9195520,"min":9195520,"q1":9195520,"q2":9195520,"q3":9195520,"max":9195520,"minLabel":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J","maxLabel":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J","q1Label":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J","q2Label":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J","q3Label":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J"},"memUsage":{"mean":114944000,"min":114944000,"q1":114944000,"q2":114944000,"q3":114944000,"max":114944000,"minLabel":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J","maxLabel":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J","q1Label":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J","q2Label":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J","q3Label":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J"},"timeUsage":null,"vmem":{"mean":16547840,"min":16547840,"q1":16547840,"q2":16547840,"q3":16547840,"max":16547840,"minLabel":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J","maxLabel":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J","q1Label":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J","q2Label":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J","q3Label":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J"},"reads":{"mean":5349209,"min":5349209,"q1":5349209,"q2":5349209,"q3":5349209,"max":5349209,"minLabel":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J","maxLabel":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J","q1Label":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J","q2Label":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J","q3Label":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J"},"cpu":{"mean":85.5,"min":85.5,"q1":85.5,"q2":85.5,"q3":85.5,"max":85.5,"minLabel":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J","maxLabel":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J","q1Label":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J","q2Label":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J","q3Label":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J"},"time":{"mean":299,"min":299,"q1":299,"q2":299,"q3":299,"max":299,"minLabel":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J","maxLabel":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J","q1Label":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J","q2Label":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J","q3Label":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J"},"writes":{"mean":3504,"min":3504,"q1":3504,"q2":3504,"q3":3504,"max":3504,"minLabel":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J","maxLabel":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J","q1Label":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J","q2Label":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J","q3Label":"SOCIALGENE:DB_CREATOR:PARAMETER_EXPORT_FOR_NEO4J"}},{"cpuUsage":{"mean":20.75,"min":20.75,"q1":20.75,"q2":20.75,"q3":20.75,"max":20.75,"minLabel":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD","maxLabel":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD","q1Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD","q2Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD","q3Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD"},"process":"NCBI_DATASETS_DOWNLOAD","mem":{"mean":21741568,"min":21741568,"q1":21741568,"q2":21741568,"q3":21741568,"max":21741568,"minLabel":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD","maxLabel":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD","q1Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD","q2Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD","q3Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD"},"memUsage":{"mean":271769600,"min":271769600,"q1":271769600,"q2":271769600,"q3":271769600,"max":271769600,"minLabel":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD","maxLabel":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD","q1Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD","q2Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD","q3Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD"},"timeUsage":null,"vmem":{"mean":1972019200,"min":1972019200,"q1":1972019200,"q2":1972019200,"q3":1972019200,"max":1972019200,"minLabel":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD","maxLabel":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD","q1Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD","q2Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD","q3Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD"},"reads":{"mean":18028839,"min":18028839,"q1":18028839,"q2":18028839,"q3":18028839,"max":18028839,"minLabel":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD","maxLabel":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD","q1Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD","q2Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD","q3Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD"},"cpu":{"mean":83,"min":83,"q1":83,"q2":83,"q3":83,"max":83,"minLabel":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD","maxLabel":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD","q1Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD","q2Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD","q3Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD"},"time":{"mean":2368,"min":2368,"q1":2368,"q2":2368,"q3":2368,"max":2368,"minLabel":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD","maxLabel":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD","q1Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD","q2Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD","q3Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD"},"writes":{"mean":17477751,"min":17477751,"q1":17477751,"q2":17477751,"q3":17477751,"max":17477751,"minLabel":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD","maxLabel":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD","q1Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD","q2Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD","q3Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENOMES:NCBI_DATASETS_DOWNLOAD"}},{"cpuUsage":{"mean":52.6,"min":52.6,"q1":52.6,"q2":52.6,"q3":52.6,"max":52.6,"minLabel":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)","maxLabel":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)","q1Label":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)","q2Label":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)","q3Label":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)"},"process":"HMM_HASH","mem":{"mean":128069632,"min":128069632,"q1":128069632,"q2":128069632,"q3":128069632,"max":128069632,"minLabel":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)","maxLabel":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)","q1Label":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)","q2Label":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)","q3Label":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)"},"memUsage":{"mean":1600870400,"min":1600870400,"q1":1600870400,"q2":1600870400,"q3":1600870400,"max":1600870400,"minLabel":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)","maxLabel":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)","q1Label":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)","q2Label":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)","q3Label":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)"},"timeUsage":null,"vmem":{"mean":455720960,"min":455720960,"q1":455720960,"q2":455720960,"q3":455720960,"max":455720960,"minLabel":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)","maxLabel":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)","q1Label":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)","q2Label":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)","q3Label":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)"},"reads":{"mean":127316744,"min":127316744,"q1":127316744,"q2":127316744,"q3":127316744,"max":127316744,"minLabel":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)","maxLabel":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)","q1Label":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)","q2Label":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)","q3Label":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)"},"cpu":{"mean":210.4,"min":210.4,"q1":210.4,"q2":210.4,"q3":210.4,"max":210.4,"minLabel":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)","maxLabel":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)","q1Label":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)","q2Label":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)","q3Label":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)"},"time":{"mean":2856,"min":2856,"q1":2856,"q2":2856,"q3":2856,"max":2856,"minLabel":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)","maxLabel":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)","q1Label":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)","q2Label":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)","q3Label":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)"},"writes":{"mean":118446214,"min":118446214,"q1":118446214,"q2":118446214,"q3":118446214,"max":118446214,"minLabel":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)","maxLabel":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)","q1Label":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)","q2Label":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)","q3Label":"SOCIALGENE:DB_CREATOR:HMM_HASH (numfiles: 1)"}},{"cpuUsage":{"mean":50.85,"min":50.85,"q1":50.85,"q2":50.85,"q3":50.85,"max":50.85,"minLabel":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE","maxLabel":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE","q1Label":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE","q2Label":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE","q3Label":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE"},"process":"HMM_TSV_PARSE","mem":{"mean":13127680,"min":13127680,"q1":13127680,"q2":13127680,"q3":13127680,"max":13127680,"minLabel":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE","maxLabel":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE","q1Label":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE","q2Label":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE","q3Label":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE"},"memUsage":{"mean":164096000,"min":164096000,"q1":164096000,"q2":164096000,"q3":164096000,"max":164096000,"minLabel":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE","maxLabel":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE","q1Label":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE","q2Label":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE","q3Label":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE"},"timeUsage":null,"vmem":{"mean":18583552,"min":18583552,"q1":18583552,"q2":18583552,"q3":18583552,"max":18583552,"minLabel":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE","maxLabel":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE","q1Label":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE","q2Label":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE","q3Label":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE"},"reads":{"mean":12363437,"min":12363437,"q1":12363437,"q2":12363437,"q3":12363437,"max":12363437,"minLabel":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE","maxLabel":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE","q1Label":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE","q2Label":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE","q3Label":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE"},"cpu":{"mean":203.4,"min":203.4,"q1":203.4,"q2":203.4,"q3":203.4,"max":203.4,"minLabel":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE","maxLabel":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE","q1Label":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE","q2Label":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE","q3Label":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE"},"time":{"mean":536,"min":536,"q1":536,"q2":536,"q3":536,"max":536,"minLabel":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE","maxLabel":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE","q1Label":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE","q2Label":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE","q3Label":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE"},"writes":{"mean":171701,"min":171701,"q1":171701,"q2":171701,"q3":171701,"max":171701,"minLabel":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE","maxLabel":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE","q1Label":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE","q2Label":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE","q3Label":"SOCIALGENE:DB_CREATOR:HMM_TSV_PARSE"}},{"cpuUsage":{"mean":94.4,"min":94.4,"q1":94.4,"q2":94.4,"q3":94.4,"max":94.4,"minLabel":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)","maxLabel":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)","q1Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)","q2Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)","q3Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)"},"process":"PROCESS_GENBANK_FILES","mem":{"mean":146042880,"min":146042880,"q1":146042880,"q2":146042880,"q3":146042880,"max":146042880,"minLabel":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)","maxLabel":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)","q1Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)","q2Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)","q3Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)"},"memUsage":{"mean":68.01,"min":68.01,"q1":68.01,"q2":68.01,"q3":68.01,"max":68.01,"minLabel":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)","maxLabel":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)","q1Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)","q2Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)","q3Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)"},"timeUsage":{"mean":0.01,"min":0.01,"q1":0.01,"q2":0.01,"q3":0.01,"max":0.01,"minLabel":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)","maxLabel":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)","q1Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)","q2Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)","q3Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)"},"vmem":{"mean":3490361344,"min":3490361344,"q1":3490361344,"q2":3490361344,"q3":3490361344,"max":3490361344,"minLabel":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)","maxLabel":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)","q1Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)","q2Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)","q3Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)"},"reads":{"mean":22073151,"min":22073151,"q1":22073151,"q2":22073151,"q3":22073151,"max":22073151,"minLabel":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)","maxLabel":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)","q1Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)","q2Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)","q3Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)"},"cpu":{"mean":94.4,"min":94.4,"q1":94.4,"q2":94.4,"q3":94.4,"max":94.4,"minLabel":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)","maxLabel":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)","q1Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)","q2Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)","q3Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)"},"time":{"mean":1927,"min":1927,"q1":1927,"q2":1927,"q3":1927,"max":1927,"minLabel":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)","maxLabel":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)","q1Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)","q2Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)","q3Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)"},"writes":{"mean":3546147,"min":3546147,"q1":3546147,"q2":3546147,"q3":3546147,"max":3546147,"minLabel":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)","maxLabel":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)","q1Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)","q2Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)","q3Label":"SOCIALGENE:DB_CREATOR:PROCESS_GENBANK_FILES (1)"}},{"cpuUsage":{"mean":24.53,"min":24.53,"q1":24.53,"q2":24.53,"q3":24.53,"max":24.53,"minLabel":"SOCIALGENE:DB_CREATOR:SEQKIT_RMDUP","maxLabel":"SOCIALGENE:DB_CREATOR:SEQKIT_RMDUP","q1Label":"SOCIALGENE:DB_CREATOR:SEQKIT_RMDUP","q2Label":"SOCIALGENE:DB_CREATOR:SEQKIT_RMDUP","q3Label":"SOCIALGENE:DB_CREATOR:SEQKIT_RMDUP"},"process":"SEQKIT_RMDUP","mem":{"mean":22024192,"min":22024192,"q1":22024192,"q2":22024192,"q3":22024192,"max":22024192,"minLabel":"SOCIALGENE:DB_CREATOR:SEQKIT_RMDUP","maxLabel":"SOCIALGENE:DB_CREATOR:SEQKIT_RMDUP","q1Label":"SOCIALGENE:DB_CREATOR:SEQKIT_RMDUP","q2Label":"SOCIALGENE:DB_CREATOR:SEQKIT_RMDUP","q3Label":"SOCIALGENE:DB_CREATOR:SEQKIT_RMDUP"},"memUsage":{"mean":275302400,"min":275302400,"q1":275302400,"q2":275302400,"q3":275302400,"max":275302400,"minLabel":"SOCIALGENE:DB_CREATOR:SEQKIT_RMDUP","maxLabel":"SOCIALGENE:DB_CREATOR:SEQKIT_RMDUP","q1Label":"SOCIALGENE:DB_CREATOR:SEQKIT_RMDUP","q2Label":"SOCIALGENE:DB_CREATOR:SEQKIT_RMDUP","q3Label":"SOCIALGENE:DB_CREATOR:SEQKIT_RMDUP"},"timeUsage":null,"vmem":{"mean":754413568,"min":754413568,"q1":754413568,"q2":754413568,"q3":754413568,"max":754413568,"minLabel":"SOCIALGENE:DB_CREATOR:SEQKIT_RMDUP","maxLabel":"SOCIALGENE:DB_CREATOR:SEQKIT_RMDUP","q1Label":"SOCIALGENE:DB_CREATOR:SEQKIT_RMDUP","q2Label":"SOCIALGENE:DB_CREATOR:SEQKIT_RMDUP","q3Label":"SOCIALGENE:DB_CREATOR:SEQKIT_RMDUP"},"reads":{"mean":3038135,"min":3038135,"q1":3038135,"q2":3038135,"q3":3038135,"max":3038135,"minLabel":"SOCIALGENE:DB_CREATOR:SEQKIT_RMDUP","maxLabel":"SOCIALGENE:DB_CREATOR:SEQKIT_RMDUP","q1Label":"SOCIALGENE:DB_CREATOR:SEQKIT_RMDUP","q2Label":"SOCIALGENE:DB_CREATOR:SEQKIT_RMDUP","q3Label":"SOCIALGENE:DB_CREATOR:SEQKIT_RMDUP"},"cpu":{"mean":98.1,"min":98.1,"q1":98.1,"q2":98.1,"q3":98.1,"max":98.1,"minLabel":"SOCIALGENE:DB_CREATOR:SEQKIT_RMDUP","maxLabel":"SOCIALGENE:DB_CREATOR:SEQKIT_RMDUP","q1Label":"SOCIALGENE:DB_CREATOR:SEQKIT_RMDUP","q2Label":"SOCIALGENE:DB_CREATOR:SEQKIT_RMDUP","q3Label":"SOCIALGENE:DB_CREATOR:SEQKIT_RMDUP"},"time":null,"writes":{"mean":2388124,"min":2388124,"q1":2388124,"q2":2388124,"q3":2388124,"max":2388124,"minLabel":"SOCIALGENE:DB_CREATOR:SEQKIT_RMDUP","maxLabel":"SOCIALGENE:DB_CREATOR:SEQKIT_RMDUP","q1Label":"SOCIALGENE:DB_CREATOR:SEQKIT_RMDUP","q2Label":"SOCIALGENE:DB_CREATOR:SEQKIT_RMDUP","q3Label":"SOCIALGENE:DB_CREATOR:SEQKIT_RMDUP"}},{"cpuUsage":{"mean":37.13,"min":37.13,"q1":37.13,"q2":37.13,"q3":37.13,"max":37.13,"minLabel":"SOCIALGENE:DB_CREATOR:DIAMOND_MAKEDB (nr.fa.gz)","maxLabel":"SOCIALGENE:DB_CREATOR:DIAMOND_MAKEDB (nr.fa.gz)","q1Label":"SOCIALGENE:DB_CREATOR:DIAMOND_MAKEDB (nr.fa.gz)","q2Label":"SOCIALGENE:DB_CREATOR:DIAMOND_MAKEDB (nr.fa.gz)","q3Label":"SOCIALGENE:DB_CREATOR:DIAMOND_MAKEDB (nr.fa.gz)"},"process":"DIAMOND_MAKEDB","mem":{"mean":8425472,"min":8425472,"q1":8425472,"q2":8425472,"q3":8425472,"max":8425472,"minLabel":"SOCIALGENE:DB_CREATOR:DIAMOND_MAKEDB (nr.fa.gz)","maxLabel":"SOCIALGENE:DB_CREATOR:DIAMOND_MAKEDB (nr.fa.gz)","q1Label":"SOCIALGENE:DB_CREATOR:DIAMOND_MAKEDB (nr.fa.gz)","q2Label":"SOCIALGENE:DB_CREATOR:DIAMOND_MAKEDB (nr.fa.gz)","q3Label":"SOCIALGENE:DB_CREATOR:DIAMOND_MAKEDB (nr.fa.gz)"},"memUsage":{"mean":105318400,"min":105318400,"q1":105318400,"q2":105318400,"q3":105318400,"max":105318400,"minLabel":"SOCIALGENE:DB_CREATOR:DIAMOND_MAKEDB (nr.fa.gz)","maxLabel":"SOCIALGENE:DB_CREATOR:DIAMOND_MAKEDB (nr.fa.gz)","q1Label":"SOCIALGENE:DB_CREATOR:DIAMOND_MAKEDB (nr.fa.gz)","q2Label":"SOCIALGENE:DB_CREATOR:DIAMOND_MAKEDB (nr.fa.gz)","q3Label":"SOCIALGENE:DB_CREATOR:DIAMOND_MAKEDB (nr.fa.gz)"},"timeUsage":null,"vmem":{"mean":19689472,"min":19689472,"q1":19689472,"q2":19689472,"q3":19689472,"max":19689472,"minLabel":"SOCIALGENE:DB_CREATOR:DIAMOND_MAKEDB (nr.fa.gz)","maxLabel":"SOCIALGENE:DB_CREATOR:DIAMOND_MAKEDB (nr.fa.gz)","q1Label":"SOCIALGENE:DB_CREATOR:DIAMOND_MAKEDB (nr.fa.gz)","q2Label":"SOCIALGENE:DB_CREATOR:DIAMOND_MAKEDB (nr.fa.gz)","q3Label":"SOCIALGENE:DB_CREATOR:DIAMOND_MAKEDB (nr.fa.gz)"},"reads":{"mean":974203,"min":974203,"q1":974203,"q2":974203,"q3":974203,"max":974203,"minLabel":"SOCIALGENE:DB_CREATOR:DIAMOND_MAKEDB (nr.fa.gz)","maxLabel":"SOCIALGENE:DB_CREATOR:DIAMOND_MAKEDB (nr.fa.gz)","q1Label":"SOCIALGENE:DB_CREATOR:DIAMOND_MAKEDB (nr.fa.gz)","q2Label":"SOCIALGENE:DB_CREATOR:DIAMOND_MAKEDB (nr.fa.gz)","q3Label":"SOCIALGENE:DB_CREATOR:DIAMOND_MAKEDB (nr.fa.gz)"},"cpu":{"mean":148.5,"min":148.5,"q1":148.5,"q2":148.5,"q3":148.5,"max":148.5,"minLabel":"SOCIALGENE:DB_CREATOR:DIAMOND_MAKEDB (nr.fa.gz)","maxLabel":"SOCIALGENE:DB_CREATOR:DIAMOND_MAKEDB (nr.fa.gz)","q1Label":"SOCIALGENE:DB_CREATOR:DIAMOND_MAKEDB (nr.fa.gz)","q2Label":"SOCIALGENE:DB_CREATOR:DIAMOND_MAKEDB (nr.fa.gz)","q3Label":"SOCIALGENE:DB_CREATOR:DIAMOND_MAKEDB (nr.fa.gz)"},"time":null,"writes":{"mean":1548063,"min":1548063,"q1":1548063,"q2":1548063,"q3":1548063,"max":1548063,"minLabel":"SOCIALGENE:DB_CREATOR:DIAMOND_MAKEDB (nr.fa.gz)","maxLabel":"SOCIALGENE:DB_CREATOR:DIAMOND_MAKEDB (nr.fa.gz)","q1Label":"SOCIALGENE:DB_CREATOR:DIAMOND_MAKEDB (nr.fa.gz)","q2Label":"SOCIALGENE:DB_CREATOR:DIAMOND_MAKEDB (nr.fa.gz)","q3Label":"SOCIALGENE:DB_CREATOR:DIAMOND_MAKEDB (nr.fa.gz)"}},{"cpuUsage":{"mean":25.05,"min":25.05,"q1":25.05,"q2":25.05,"q3":25.05,"max":25.05,"minLabel":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS","maxLabel":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS","q1Label":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS","q2Label":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS","q3Label":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS"},"process":"TAXDUMP_PROCESS","mem":{"mean":1632481280,"min":1632481280,"q1":1632481280,"q2":1632481280,"q3":1632481280,"max":1632481280,"minLabel":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS","maxLabel":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS","q1Label":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS","q2Label":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS","q3Label":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS"},"memUsage":{"mean":20406016000,"min":20406016000,"q1":20406016000,"q2":20406016000,"q3":20406016000,"max":20406016000,"minLabel":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS","maxLabel":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS","q1Label":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS","q2Label":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS","q3Label":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS"},"timeUsage":{"mean":0.02,"min":0.02,"q1":0.02,"q2":0.02,"q3":0.02,"max":0.02,"minLabel":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS","maxLabel":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS","q1Label":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS","q2Label":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS","q3Label":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS"},"vmem":{"mean":4978655232,"min":4978655232,"q1":4978655232,"q2":4978655232,"q3":4978655232,"max":4978655232,"minLabel":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS","maxLabel":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS","q1Label":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS","q2Label":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS","q3Label":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS"},"reads":{"mean":406673047,"min":406673047,"q1":406673047,"q2":406673047,"q3":406673047,"max":406673047,"minLabel":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS","maxLabel":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS","q1Label":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS","q2Label":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS","q3Label":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS"},"cpu":{"mean":100.2,"min":100.2,"q1":100.2,"q2":100.2,"q3":100.2,"max":100.2,"minLabel":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS","maxLabel":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS","q1Label":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS","q2Label":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS","q3Label":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS"},"time":{"mean":20733,"min":20733,"q1":20733,"q2":20733,"q3":20733,"max":20733,"minLabel":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS","maxLabel":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS","q1Label":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS","q2Label":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS","q3Label":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS"},"writes":{"mean":175622098,"min":175622098,"q1":175622098,"q2":175622098,"q3":175622098,"max":175622098,"minLabel":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS","maxLabel":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS","q1Label":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS","q2Label":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS","q3Label":"SOCIALGENE:DB_CREATOR:NCBI_TAXONOMY_INFO:TAXDUMP_PROCESS"}},{"cpuUsage":{"mean":64.48,"min":64.48,"q1":64.48,"q2":64.48,"q3":64.48,"max":64.48,"minLabel":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER","maxLabel":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER","q1Label":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER","q2Label":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER","q3Label":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER"},"process":"MMSEQS2_EASYCLUSTER","mem":{"mean":935542784,"min":935542784,"q1":935542784,"q2":935542784,"q3":935542784,"max":935542784,"minLabel":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER","maxLabel":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER","q1Label":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER","q2Label":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER","q3Label":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER"},"memUsage":{"mean":11694284800,"min":11694284800,"q1":11694284800,"q2":11694284800,"q3":11694284800,"max":11694284800,"minLabel":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER","maxLabel":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER","q1Label":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER","q2Label":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER","q3Label":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER"},"timeUsage":null,"vmem":{"mean":8688414720,"min":8688414720,"q1":8688414720,"q2":8688414720,"q3":8688414720,"max":8688414720,"minLabel":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER","maxLabel":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER","q1Label":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER","q2Label":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER","q3Label":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER"},"reads":{"mean":11131491,"min":11131491,"q1":11131491,"q2":11131491,"q3":11131491,"max":11131491,"minLabel":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER","maxLabel":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER","q1Label":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER","q2Label":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER","q3Label":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER"},"cpu":{"mean":1547.6,"min":1547.6,"q1":1547.6,"q2":1547.6,"q3":1547.6,"max":1547.6,"minLabel":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER","maxLabel":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER","q1Label":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER","q2Label":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER","q3Label":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER"},"time":{"mean":3899,"min":3899,"q1":3899,"q2":3899,"q3":3899,"max":3899,"minLabel":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER","maxLabel":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER","q1Label":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER","q2Label":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER","q3Label":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER"},"writes":{"mean":17517386,"min":17517386,"q1":17517386,"q2":17517386,"q3":17517386,"max":17517386,"minLabel":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER","maxLabel":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER","q1Label":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER","q2Label":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER","q3Label":"SOCIALGENE:DB_CREATOR:MMSEQS2_EASYCLUSTER"}},{"cpuUsage":{"mean":4.9,"min":4.9,"q1":4.9,"q2":4.9,"q3":4.9,"max":4.9,"minLabel":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT","maxLabel":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT","q1Label":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT","q2Label":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT","q3Label":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT"},"process":"SEQKIT_SPLIT","mem":{"mean":8220672,"min":8220672,"q1":8220672,"q2":8220672,"q3":8220672,"max":8220672,"minLabel":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT","maxLabel":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT","q1Label":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT","q2Label":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT","q3Label":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT"},"memUsage":{"mean":102758400,"min":102758400,"q1":102758400,"q2":102758400,"q3":102758400,"max":102758400,"minLabel":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT","maxLabel":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT","q1Label":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT","q2Label":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT","q3Label":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT"},"timeUsage":null,"vmem":{"mean":747687936,"min":747687936,"q1":747687936,"q2":747687936,"q3":747687936,"max":747687936,"minLabel":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT","maxLabel":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT","q1Label":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT","q2Label":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT","q3Label":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT"},"reads":{"mean":964550,"min":964550,"q1":964550,"q2":964550,"q3":964550,"max":964550,"minLabel":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT","maxLabel":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT","q1Label":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT","q2Label":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT","q3Label":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT"},"cpu":{"mean":117.7,"min":117.7,"q1":117.7,"q2":117.7,"q3":117.7,"max":117.7,"minLabel":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT","maxLabel":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT","q1Label":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT","q2Label":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT","q3Label":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT"},"time":{"mean":142,"min":142,"q1":142,"q2":142,"q3":142,"max":142,"minLabel":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT","maxLabel":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT","q1Label":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT","q2Label":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT","q3Label":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT"},"writes":{"mean":1095515,"min":1095515,"q1":1095515,"q2":1095515,"q3":1095515,"max":1095515,"minLabel":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT","maxLabel":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT","q1Label":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT","q2Label":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT","q3Label":"SOCIALGENE:DB_CREATOR:SEQKIT_SPLIT"}},{"cpuUsage":{"mean":43.7,"min":43.7,"q1":43.7,"q2":43.7,"q3":43.7,"max":43.7,"minLabel":"SOCIALGENE:DB_CREATOR:DIAMOND_BLASTP","maxLabel":"SOCIALGENE:DB_CREATOR:DIAMOND_BLASTP","q1Label":"SOCIALGENE:DB_CREATOR:DIAMOND_BLASTP","q2Label":"SOCIALGENE:DB_CREATOR:DIAMOND_BLASTP","q3Label":"SOCIALGENE:DB_CREATOR:DIAMOND_BLASTP"},"process":"DIAMOND_BLASTP","mem":{"mean":15130624,"min":15130624,"q1":15130624,"q2":15130624,"q3":15130624,"max":15130624,"minLabel":"SOCIALGENE:DB_CREATOR:DIAMOND_BLASTP","maxLabel":"SOCIALGENE:DB_CREATOR:DIAMOND_BLASTP","q1Label":"SOCIALGENE:DB_CREATOR:DIAMOND_BLASTP","q2Label":"SOCIALGENE:DB_CREATOR:DIAMOND_BLASTP","q3Label":"SOCIALGENE:DB_CREATOR:DIAMOND_BLASTP"},"memUsage":{"mean":189132800,"min":189132800,"q1":189132800,"q2":189132800,"q3":189132800,"max":189132800,"minLabel":"SOCIALGENE:DB_CREATOR:DIAMOND_BLASTP","maxLabel":"SOCIALGENE:DB_CREATOR:DIAMOND_BLASTP","q1Label":"SOCIALGENE:DB_CREATOR:DIAMOND_BLASTP","q2Label":"SOCIALGENE:DB_CREATOR:DIAMOND_BLASTP","q3Label":"SOCIALGENE:DB_CREATOR:DIAMOND_BLASTP"},"timeUsage":null,"vmem":{"mean":356425728,"min":356425728,"q1":356425728,"q2":356425728,"q3":356425728,"max":356425728,"minLabel":"SOCIALGENE:DB_CREATOR:DIAMOND_BLASTP","maxLabel":"SOCIALGENE:DB_CREATOR:DIAMOND_BLASTP","q1Label":"SOCIALGENE:DB_CREATOR:DIAMOND_BLASTP","q2Label":"SOCIALGENE:DB_CREATOR:DIAMOND_BLASTP","q3Label":"SOCIALGENE:DB_CREATOR:DIAMOND_BLASTP"},"reads":{"mean":6629071,"min":6629071,"q1":6629071,"q2":6629071,"q3":6629071,"max":6629071,"minLabel":"SOCIALGENE:DB_CREATOR:DIAMOND_BLASTP","maxLabel":"SOCIALGENE:DB_CREATOR:DIAMOND_BLASTP","q1Label":"SOCIALGENE:DB_CREATOR:DIAMOND_BLASTP","q2Label":"SOCIALGENE:DB_CREATOR:DIAMOND_BLASTP","q3Label":"SOCIALGENE:DB_CREATOR:DIAMOND_BLASTP"},"cpu":{"mean":1048.7,"min":1048.7,"q1":1048.7,"q2":1048.7,"q3":1048.7,"max":1048.7,"minLabel":"SOCIALGENE:DB_CREATOR:DIAMOND_BLASTP","maxLabel":"SOCIALGENE:DB_CREATOR:DIAMOND_BLASTP","q1Label":"SOCIALGENE:DB_CREATOR:DIAMOND_BLASTP","q2Label":"SOCIALGENE:DB_CREATOR:DIAMOND_BLASTP","q3Label":"SOCIALGENE:DB_CREATOR:DIAMOND_BLASTP"},"time":null,"writes":{"mean":981032,"min":981032,"q1":981032,"q2":981032,"q3":981032,"max":981032,"minLabel":"SOCIALGENE:DB_CREATOR:DIAMOND_BLASTP","maxLabel":"SOCIALGENE:DB_CREATOR:DIAMOND_BLASTP","q1Label":"SOCIALGENE:DB_CREATOR:DIAMOND_BLASTP","q2Label":"SOCIALGENE:DB_CREATOR:DIAMOND_BLASTP","q3Label":"SOCIALGENE:DB_CREATOR:DIAMOND_BLASTP"}},{"cpuUsage":{"mean":87.73,"min":84,"q1":85.2,"q2":88.1,"q3":89.95,"max":92.3,"minLabel":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (1)","maxLabel":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (8)","q1Label":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (6)","q2Label":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (4)","q3Label":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (19)"},"process":"HMMER_HMMSEARCH","mem":{"mean":32327769.04,"min":19738624,"q1":27893760,"q2":29872128,"q3":35979264,"max":52232192,"minLabel":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (20)","maxLabel":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (1)","q1Label":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (22)","q2Label":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (9)","q3Label":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (5)"},"memUsage":{"mean":1616388452.17,"min":986931200,"q1":1394688000,"q2":1493606400,"q3":1798963200,"max":2611609600,"minLabel":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (20)","maxLabel":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (1)","q1Label":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (22)","q2Label":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (9)","q3Label":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (5)"},"timeUsage":null,"vmem":{"mean":160555008,"min":160555008,"q1":160555008,"q2":160555008,"q3":160555008,"max":160555008,"minLabel":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (2)","maxLabel":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (3)","q1Label":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (6)","q2Label":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (13)","q3Label":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (8)"},"reads":{"mean":171782250.74,"min":164524353,"q1":169044891.5,"q2":172090239,"q3":174138017.5,"max":177063167,"minLabel":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (9)","maxLabel":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (1)","q1Label":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (6)","q2Label":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (16)","q3Label":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (15)"},"cpu":{"mean":87.73,"min":84,"q1":85.2,"q2":88.1,"q3":89.95,"max":92.3,"minLabel":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (1)","maxLabel":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (8)","q1Label":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (6)","q2Label":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (4)","q3Label":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (19)"},"time":{"mean":4947.13,"min":4442,"q1":4717.5,"q2":4904,"q3":5195,"max":5412,"minLabel":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (7)","maxLabel":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (5)","q1Label":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (22)","q2Label":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (18)","q3Label":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (1)"},"writes":{"mean":100801047.61,"min":100642860,"q1":100717412.5,"q2":100755115,"q3":100905224,"max":100985125,"minLabel":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (18)","maxLabel":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (12)","q1Label":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (21)","q2Label":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (8)","q3Label":"SOCIALGENE:DB_CREATOR:HMMER_HMMSEARCH (20)"}},{"cpuUsage":{"mean":94.99,"min":91.4,"q1":93.9,"q2":95,"q3":96.4,"max":98.9,"minLabel":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (21)","maxLabel":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (17)","q1Label":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (15)","q2Label":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (13)","q3Label":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (2)"},"process":"HMMSEARCH_PARSE","mem":{"mean":12111693.91,"min":3264512,"q1":11808768,"q2":12128256,"q3":12597248,"max":14663680,"minLabel":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (12)","maxLabel":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (3)","q1Label":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (17)","q2Label":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (2)","q3Label":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (7)"},"memUsage":{"mean":151396173.91,"min":40806400,"q1":147609600,"q2":151603200,"q3":157465600,"max":183296000,"minLabel":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (12)","maxLabel":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (3)","q1Label":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (17)","q2Label":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (2)","q3Label":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (7)"},"timeUsage":{"mean":0.01,"min":0.01,"q1":0.01,"q2":0.01,"q3":0.01,"max":0.01,"minLabel":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (22)","maxLabel":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (11)","q1Label":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (17)","q2Label":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (18)","q3Label":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (13)"},"vmem":{"mean":18074223.3,"min":5881856,"q1":18157568,"q2":18157568,"q3":18321408,"max":20525056,"minLabel":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (12)","maxLabel":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (21)","q1Label":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (10)","q2Label":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (23)","q3Label":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (7)"},"reads":{"mean":14940305.7,"min":14926646,"q1":14932556,"q2":14937003,"q3":14948191,"max":14957131,"minLabel":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (7)","maxLabel":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (9)","q1Label":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (13)","q2Label":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (17)","q3Label":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (12)"},"cpu":{"mean":94.99,"min":91.4,"q1":93.9,"q2":95,"q3":96.4,"max":98.9,"minLabel":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (21)","maxLabel":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (17)","q1Label":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (15)","q2Label":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (13)","q3Label":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (2)"},"time":{"mean":872.91,"min":741,"q1":803,"q2":844,"q3":933,"max":1040,"minLabel":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (22)","maxLabel":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (11)","q1Label":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (17)","q2Label":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (18)","q3Label":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (13)"},"writes":{"mean":40241.22,"min":30448,"q1":34656.5,"q2":38638,"q3":44775,"max":51528,"minLabel":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (7)","maxLabel":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (9)","q1Label":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (18)","q2Label":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (17)","q3Label":"SOCIALGENE:DB_CREATOR:HMMSEARCH_PARSE (21)"}},{"cpuUsage":{"mean":0.31,"min":0.31,"q1":0.31,"q2":0.31,"q3":0.31,"max":0.31,"minLabel":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)","maxLabel":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)","q1Label":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)","q2Label":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)","q3Label":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)"},"process":"NEO4J_ADMIN_IMPORT","mem":{"mean":13287424,"min":13287424,"q1":13287424,"q2":13287424,"q3":13287424,"max":13287424,"minLabel":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)","maxLabel":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)","q1Label":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)","q2Label":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)","q3Label":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)"},"memUsage":{"mean":166092800,"min":166092800,"q1":166092800,"q2":166092800,"q3":166092800,"max":166092800,"minLabel":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)","maxLabel":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)","q1Label":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)","q2Label":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)","q3Label":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)"},"timeUsage":null,"vmem":{"mean":21729280,"min":21729280,"q1":21729280,"q2":21729280,"q3":21729280,"max":21729280,"minLabel":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)","maxLabel":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)","q1Label":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)","q2Label":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)","q3Label":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)"},"reads":{"mean":36670723,"min":36670723,"q1":36670723,"q2":36670723,"q3":36670723,"max":36670723,"minLabel":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)","maxLabel":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)","q1Label":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)","q2Label":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)","q3Label":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)"},"cpu":{"mean":7.5,"min":7.5,"q1":7.5,"q2":7.5,"q3":7.5,"max":7.5,"minLabel":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)","maxLabel":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)","q1Label":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)","q2Label":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)","q3Label":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)"},"time":{"mean":8787,"min":8787,"q1":8787,"q2":8787,"q3":8787,"max":8787,"minLabel":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)","maxLabel":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)","q1Label":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)","q2Label":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)","q3Label":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)"},"writes":{"mean":68968408,"min":68968408,"q1":68968408,"q2":68968408,"q3":68968408,"max":68968408,"minLabel":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)","maxLabel":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)","q1Label":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)","q2Label":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)","q3Label":"SOCIALGENE:DB_CREATOR:NEO4J_ADMIN_IMPORT (Building Neo4j database)"}},{"cpuUsage":{"mean":18.1,"min":18.1,"q1":18.1,"q2":18.1,"q3":18.1,"max":18.1,"minLabel":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)","maxLabel":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)","q1Label":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)","q2Label":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)","q3Label":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)"},"process":"CUSTOM_DUMPSOFTWAREVERSIONS","mem":{"mean":4681728,"min":4681728,"q1":4681728,"q2":4681728,"q3":4681728,"max":4681728,"minLabel":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)","maxLabel":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)","q1Label":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)","q2Label":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)","q3Label":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)"},"memUsage":{"mean":58521600,"min":58521600,"q1":58521600,"q2":58521600,"q3":58521600,"max":58521600,"minLabel":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)","maxLabel":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)","q1Label":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)","q2Label":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)","q3Label":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)"},"timeUsage":null,"vmem":{"mean":12042240,"min":12042240,"q1":12042240,"q2":12042240,"q3":12042240,"max":12042240,"minLabel":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)","maxLabel":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)","q1Label":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)","q2Label":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)","q3Label":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)"},"reads":{"mean":937838,"min":937838,"q1":937838,"q2":937838,"q3":937838,"max":937838,"minLabel":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)","maxLabel":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)","q1Label":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)","q2Label":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)","q3Label":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)"},"cpu":{"mean":72.4,"min":72.4,"q1":72.4,"q2":72.4,"q3":72.4,"max":72.4,"minLabel":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)","maxLabel":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)","q1Label":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)","q2Label":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)","q3Label":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)"},"time":{"mean":83,"min":83,"q1":83,"q2":83,"q3":83,"max":83,"minLabel":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)","maxLabel":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)","q1Label":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)","q2Label":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)","q3Label":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)"},"writes":{"mean":5654,"min":5654,"q1":5654,"q2":5654,"q3":5654,"max":5654,"minLabel":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)","maxLabel":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)","q1Label":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)","q2Label":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)","q3Label":"SOCIALGENE:DB_CREATOR:CUSTOM_DUMPSOFTWAREVERSIONS (1)"}}]
Sep-06 11:03:21.639 [main] DEBUG nextflow.trace.TimelineObserver - Flow completing -- rendering html timeline
Sep-06 11:03:21.723 [main] DEBUG nextflow.cache.CacheDB - Closing CacheDB done
Sep-06 11:03:21.730 [main] DEBUG nextflow.script.ScriptRunner - > Execution complete -- Goodbye
pditommaso commented 2 years ago

What version are you using?

chasemc commented 2 years ago

Sorry, 22.04.0.

It's a DSL2 workflow and pretty large so I've been working to whittle it down to the source and it does appear to a .buffer() from a DSL2 subworkflow output

chasemc commented 2 years ago

I lost a lot of time on that so I just reverted some commits back on my pipeline and something fixed it though I'm still not sure what (Fortunately/Unfortunately). If the issue comes back I'll let you know, otherwise I am unable to reproduce the error at this time.

DriesSchaumont commented 2 years ago

I managed to reproduce the error when pushing a null value in the output from toList() and using view: N E X T F L O W ~ version 21.10.6

nextflow.enable.dsl=2
workflow {
  Channel.fromList(["foo"])
    | toList()
    | map { bar -> null }
    | view()
}
chasemc commented 2 years ago

That fits what I believe was happening in my case

stale[bot] commented 1 year ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

mes5k commented 1 year ago

I managed to reproduce the error when pushing a null value in the output from toList() and using view: N E X T F L O W ~ version 21.10.6

nextflow.enable.dsl=2
workflow {
  Channel.fromList(["foo"])
    | toList()
    | map { bar -> null }
    | view()
}

@DriesSchaumont while this does hang I don't see the "DEBUG n.processor.TaskPollingMonitor - No more task to compute -- Execution may be stalled" log messages, so I'm not sure it's the same problem. Also using 21.10.6.

pditommaso commented 1 year ago

I think this is somehow "expected". What happens is that the null is considered as lack of value by the underlying dataflow library and therefore the view event is never triggered.

If the null is meant to skip some value you should consider the use of filter, eg. 

  Channel.fromList(["foo"])
    | toList()
    | filter { bar -> bar!='foo' }
    | view()