snowplow-incubator / snowplow-lake-loader

Snowplow Lake Loader
Other
0 stars 3 forks source link

Extend health probe to report unhealthy on more error scenarios #69

Closed istreeter closed 4 months ago

istreeter commented 4 months ago

This PR follows the same style of health probe we did in BigQuery Loader v2 and in Snowflake Loader.

It adds a new trait LakeWriter.WithHandledErrors which similar to what we did here in BigQuery Loader. It means we can use the same nice pattern of writing unit tests for this class. In follow up work we can extend WithHandledErrors to manage the retry logic and reporting setup errors to a webhook.