fix(backfills): switch to concurrent.futures to improve debuggability

mozilla / bigquery-etl

Bigquery ETL

https://mozilla.github.io/bigquery-etl

Mozilla Public License 2.0

246 stars 98 forks source link

fix(backfills): switch to concurrent.futures to improve debuggability #5653

Closed ANich closed 2 months ago

ANich commented 2 months ago

I believe this is the preferred way to do multithreading/processing while maintaining individual exception context. Adapted from the concurrent.futures docs.

Will update from Exception in a future PR to something more specific.

┆Issue is synchronized with this Jira Task