sources/ldap: add rate limit delay, increase timeouts, add request to-restart

ChandonPierre commented 5 days ago

Details

We continually run into rate limiting issues syncing against an upstream Google Secure LDAP service. This PR:

Adds a configurable pause between page searches
Extends connect timeout
Makes ldap3 exceptions togglable
Changes default SYNC client strategy to RESTARTABLE to handle connection failure retries, instead of halting the sync operation

Checklist

[ ] Local tests pass (ak test authentik/)
[ ] The code has been formatted (make lint-fix)

If an API change has been made

[ ] The API schema has been updated (make gen-build)

If changes to the frontend have been made

[ ] The code has been formatted (make web)

If applicable

[ ] The documentation has been updated
[ ] The documentation has been formatted (make website)

netlify[bot] commented 5 days ago

Deploy Preview for authentik-docs canceled.

Name	Link
Latest commit	8466f125ec59974da1f843d27127bf240b624de9
Latest deploy log	https://app.netlify.com/sites/authentik-docs/deploys/6739a3f5407aca000855fd53

netlify[bot] commented 5 days ago

Deploy Preview for authentik-storybook canceled.

Name	Link
Latest commit	8466f125ec59974da1f843d27127bf240b624de9
Latest deploy log	https://app.netlify.com/sites/authentik-storybook/deploys/6739a3f50e59d20008f01a4e

codecov[bot] commented 5 days ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 50.49%. Comparing base (550e24e) to head (8466f12).

:exclamation: There is a different number of reports uploaded between BASE (550e24e) and HEAD (8466f12). Click for more details.

HEAD has 3 uploads less than BASE
| Flag | BASE (550e24e) | HEAD (8466f12) | |------|------|------| |e2e|8|7| |unit|2|0|

Additional details and impacted files

```diff @@ Coverage Diff @@ ## main #12056 +/- ## =========================================== - Coverage 92.58% 50.49% -42.09% =========================================== Files 761 759 -2 Lines 37863 37604 -259 =========================================== - Hits 35057 18990 -16067 - Misses 2806 18614 +15808 ``` | [Flag](https://app.codecov.io/gh/goauthentik/authentik/pull/12056/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=goauthentik) | Coverage Δ | | |---|---|---| | [e2e](https://app.codecov.io/gh/goauthentik/authentik/pull/12056/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=goauthentik) | `49.22% <100.00%> (+0.06%)` | :arrow_up: | | [integration](https://app.codecov.io/gh/goauthentik/authentik/pull/12056/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=goauthentik) | `24.90% <50.00%> (+<0.01%)` | :arrow_up: | | [unit](https://app.codecov.io/gh/goauthentik/authentik/pull/12056/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=goauthentik) | `?` | | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=goauthentik#carryforward-flags-in-the-pull-request-comment) to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

goauthentik / authentik