search

reanahub / reana-workflow-engine-snakemake

REANA Workflow Engine Snakemake
MIT License
0 stars 21 forks source link

logs: misleading memory and disk limit #90

Closed mdonadoni closed 3 months ago

mdonadoni commented 4 months ago

After upgrading Snakemake in https://github.com/reanahub/reana-workflow-engine-snakemake/pull/81, the workflow engine logs now report the following resources for each rule:

snakemake.logging | MainThread | INFO | rule worldpopulation:
    input: code/worldpopulation.ipynb, data/World_historical_and_predicted_populations_in_percentage.csv
    output: results/plot.png
    jobid: 1
    resources: mem_mb=1000, mem_mib=954, disk_mb=1000, disk_mib=954, tmpdir=<TBD>

These resources are however misleading, as REANA does not enforce these limits (e.g. for memory REANA uses kubernetes_memory_limit), so they should be removed from the logs to avoid confusion.