search

StackStorm / st2

StackStorm (aka "IFTTT for Ops") is event-driven automation for auto-remediation, incident responses, troubleshooting, deployments, and more for DevOps and SREs. Includes rules engine, workflow, 160 integration packs with 6000+ actions (see https://exchange.stackstorm.org) and ChatOps. Installer at https://docs.stackstorm.com/install/index.html
https://stackstorm.com/
Apache License 2.0
5.96k stars 744 forks source link

Optimize 'st2 pack register' performance #3686

Open arm4b opened 6 years ago

arm4b commented 6 years ago

With the ballooned AWS pack (3581 actions) users sometimes got failures on slower systems during the st2 pack install aws (reported in #community).

The "temporary" workaround was to increase pack register content timeout https://github.com/StackStorm/st2/pull/3685 but it's a matter of time until we'll need the next timeout increase.

While it wasn't a problem before, we eventually have to look into performance optimizations for st2 pack register. Now think about st2 pack install <20+ packs here> which is typical story in any pack management. StackStorm by design should be able to handle big packs.

cc @StackStorm/team

arm4b commented 6 years ago

For example, on my laptop registering aws 3581 actions takes 2m4.894s, meaning ~30 actions/second. Guessing if we can do better.