It would be nice to build a module to look at the performance of modules - if they're using the resources that they allocate, especially time.
Uppmax have some nice tools to look at this. I think that a module could scrape the submission log text file to get Job IDs and submission resources, then compare this to what was actually used.
For example:
finishedjobinfo -j 5046208
gives: (split onto multiple lines for readability)
Ideally, the module could run some custom stats and then build a summary HTML report or something? Maybe e-mail this? Could be cool if it could log some stats centrally somewhere too.
Finally, this may need an extra feature in CF to have the option to always append or prepend modules to every pipeline. Probably a good thing to have anyway, and should be a relatively easy config addon?
It would be nice to build a module to look at the performance of modules - if they're using the resources that they allocate, especially time.
Uppmax have some nice tools to look at this. I think that a module could scrape the submission log text file to get Job IDs and submission resources, then compare this to what was actually used.
For example:
gives: (split onto multiple lines for readability)
Also can run
jobstats
:Gives:
And this:![milou-b2013064-phil-5046208](https://cloud.githubusercontent.com/assets/465550/7119095/c84fb106-e203-11e4-84aa-6b72a712cfb6.png)
Ideally, the module could run some custom stats and then build a summary HTML report or something? Maybe e-mail this? Could be cool if it could log some stats centrally somewhere too.
Finally, this may need an extra feature in CF to have the option to always append or prepend modules to every pipeline. Probably a good thing to have anyway, and should be a relatively easy config addon?