stfc / st2-cloud-pack

A bespoke pack for SCD Cloud containing elements for managing Openstack and supporting infrastructure
0 stars 5 forks source link

Improve poor FreeIPA scaling #43

Closed ElliottKasoar closed 2 years ago

ElliottKasoar commented 2 years ago

Creating and deleting FreeIPA users scales very poorly, which appears to be significantly affected by the output steps. For example:

With current output:

With no output:

joelvdavies commented 2 years ago

Just to add some info, it appears its the loops in the workflow that adds a lot of the time (see https://github.com/StackStorm/st2/issues/4882).

ElliottKasoar commented 2 years ago

This issue is not directly tied to the output, as similar issues occur with the output removed once 100+ users are being created or deleted - the creation/deletion itself on FreeIPA is occurs relatively quickly, but the action is very slow to finish.

Calling a single script once, which loops over the users (e.g. https://github.com/stfc/ansible-jupyter/tree/main/scripts) appears to be far more efficient. Subbing these scripts in for the built-in action may be the best approach.

DavidFair commented 2 years ago

Closed as wont fix, as we've switched to a script