search

galaxyproject / gxadmin

Handy command line utility for Galaxy administrators :rocket:
https://galaxyproject.github.io/gxadmin/#/
GNU General Public License v3.0
23 stars 28 forks source link

find heavily used tools with large runtime #126

Open bgruening opened 1 year ago

bgruening commented 1 year ago

I would like to start optimizing some tools. I think we can find some BA and MA students to optimize our tool stack and with that waste fewer resources.

To prepare a query like gxadmin query tool-usage but with a min/avg/max runtime column would be super useful.

hexylena commented 1 year ago

you've fixed the cgroup data we were getting? That's exciting to hear. How did that happen? Last time I looked at it some of the cgroup data was a bit suspect, to say the least.

bgruening commented 1 year ago

Nope, not fixed I think, they are still very flaky. But here we only need runtimes. An estimate of 1h+ is enough I would say to rank a few tools top. I suspect all the galaxy_sequence_utils popping up top, or some small python/perl scripts ... groomer etc ... hopefully ... those would be also low-hanging fruits to make them faster.

hexylena commented 1 year ago

damn, I was hopeful. Makes sense, good luck!

On Tue, 14 Feb 2023, 00:00 Björn Grüning, @.***> wrote:

Nope, not fixed I think, they are still very flaky. But here we only need runtimes. An estimate of 1h+ is enough I would say to rank a few tools top. I suspect all the galaxy_sequence_utils popping up top, or some small python/perl scripts ... groomer etc ... hopefully ... those would be also low-hanging fruits to make them faster.

— Reply to this email directly, view it on GitHub https://github.com/galaxyproject/gxadmin/issues/126#issuecomment-1428821159, or unsubscribe https://github.com/notifications/unsubscribe-auth/AADP7O6EP6ZXWMXHA7D6TFLWXK4IRANCNFSM6AAAAAAUZK277Y . You are receiving this because you commented.Message ID: @.***>