search

databio / dnameth_pipelines

PEP-compatible pipelines for DNA methylation data (RRBS, WGBS)
2 stars 1 forks source link

Monitor resource usage and adjust pipeline interface accordingly #16

Open vreuter opened 5 years ago

vreuter commented 5 years ago

Now may be a good time to assess resource usage of the bisulfite pipelines, when a variety of samples are being processed in relative proximity. The pipeline interface could be updated to reflect observation of resource usage during these runs.

nsheff commented 5 years ago

good idea. make sure you're using the latest pypiper, which increased accuracy for mem monitoring.

nsheff commented 5 years ago

also don't make the bounds too tight... nothing worse than getting a long-running job killed because it barely went over some limit.