Tomme / dbt-athena

The athena adapter plugin for dbt (https://getdbt.com)
Apache License 2.0
142 stars 79 forks source link

Add poll interval option #11

Closed Dandandan closed 3 years ago

Dandandan commented 3 years ago

It is quite easy in Athena to get rate limiting errors when using multiple (e.g. 8) threads in dbt. The default rate limits are between ~5-20 / s for some API calls, so quite easy to get to that limit using dbt.

Dandandan commented 3 years ago

@Tomme this is ready for review :)