cloudquery / cloudquery

The open source high performance ELT framework powered by Apache Arrow
https://cloudquery.io
Mozilla Public License 2.0
5.82k stars 507 forks source link

feat(aws): Expose retry & backoff config for AWS source plugin #9350

Closed candiduslynx closed 1 year ago

candiduslynx commented 1 year ago

Which problem is this feature request solving?

If the API quota is too little some resources may be skipped. Part of #8941

Describe the solution you'd like

Allow users to specify amount of retries and other backoff options in AWS config

Pull request (optional)

candiduslynx commented 1 year ago

Already done via max_retries and max_backoff settings in AWS source plugin spec.