iRNA-COSI / APAeval

Community effort to evaluate computational methods for the detection and quantification of poly(A) sites and estimating their differential usage across RNA-seq samples
MIT License
13 stars 14 forks source link

feat(Execution workflow):Time and memory usage #270

Open faricazjj opened 2 years ago

faricazjj commented 2 years ago

Child issues

Proof of concept: https://github.com/iRNA-COSI/APAeval/issues/287 Implementation: https://github.com/iRNA-COSI/APAeval/issues/288 Results: https://github.com/iRNA-COSI/APAeval/issues/289

Description

We want to add time and memory usage information of the execution workflows as a benchmarking metric for tool efficiency

dominikburri commented 2 years ago

Maybe the draft PR #165 can be helpful, it contains examples on how to obtain the above information irrespective of workflow language. I think this was one of the difficulty when we started to look into this. Nextflow and Snakemake have both a way to report this but not sure on how comparable the measures are.