search

reanahub / reana-workflow-engine-snakemake

REANA Workflow Engine Snakemake
MIT License
0 stars 22 forks source link

executor: duplicated logs #18

Closed mvidalgarcia closed 2 years ago

mvidalgarcia commented 2 years ago

Current behavior

$ reana-client logs -w helloworld-snakemake-kubernetes
2021-09-16 10:40:58,461 | reana-workflow-engine-snakemake | MainThread | INFO | Workflow spec received: workflow/snakemake/Snakefile                                                                             
2021-09-16 10:40:58,491 | filelock | MainThread | INFO | Lock 140200480270752 acquired on /tmp/tmpy07judgrsnakemake-runtime-source-cache/4652fbcd66706e7799964f31852b800f0da59a2e646f480329cabbe77b6ab526.lock
2021-09-16 10:40:58,491 | filelock | MainThread | INFO | Lock 140200480270752 released on /tmp/tmpy07judgrsnakemake-runtime-source-cache/4652fbcd66706e7799964f31852b800f0da59a2e646f480329cabbe77b6ab526.lock
Building DAG of jobs...                             
2021-09-16 10:40:58,501 | snakemake.logging | MainThread | WARNING | Building DAG of jobs...
Using shell: /bin/bash                              2021-09-16 10:40:58,559 | snakemake.logging | MainThread | WARNING | Using shell: /bin/bash                                                                                                                      Provided cluster nodes: 4                           2021-09-16 10:40:58,559 | snakemake.logging | MainThread | WARNING | Provided cluster nodes: 4Singularity containers: ignored                     2021-09-16 10:40:58,559 | snakemake.logging | MainThread | WARNING | Singularity containers: ignored
Job stats:                                          
job           count    min threads    max threads
----------  -------  -------------  -------------
all               1              1              1
helloworld        1              1              1
total             2              1              1

2021-09-16 10:40:58,565 | snakemake.logging | MainThread | WARNING | Job stats:
job           count    min threads    max threads
----------  -------  -------------  -------------
all               1              1              1
helloworld        1              1              1
total             2              1              1
...

Snakemake logs are duplicated. Notice that some of them are prefixed with 2021-09-16 10:40:58,565 | snakemake.logging | MainThread | WARNING | and others not.

Expected behavior

Logs shouldn't be duplicated.