search

galaxyproject / planemo

Command-line utilities to assist in developing Galaxy and Common Workflow Language artifacts - including tools, workflows, and training materials.
https://planemo.readthedocs.io/
MIT License
90 stars 85 forks source link

Detailed execution metrics on test runs #740

Open jmfernandez opened 7 years ago

jmfernandez commented 7 years ago

WP2 ELIXIR-EXCELERATE benchmarking and technical monitoring team ( @scapella , @jlgelpi , @diglesia , @jmfernandez , @redmitry ) is planning to use planemo to test whether the different versions of bioconda tools with recipes at https://github.com/galaxyproject/tools-iuc are still working.

As we are also interested in the technical benchmarking of the tools, we want to gather metrics like the execution time, used memory, used CPU, etc... We have been talking to @bgruening about this enhancement, and he explained us that it is possible, because Galaxy core already gathers it. So, could you add to the generated JSON all those metrics obtained from each test, please?

jmchilton commented 7 years ago

Sorry - I missed this. This is an excellent idea - I've wanted to do something like this for a long time. I'll try to find some time to do this but I can't make any promises.