Keep dead_letters table/client on demand

delta-io / kafka-delta-ingest

A highly efficient daemon for streaming data from Kafka into Delta Lake

Apache License 2.0

337 stars 72 forks source link

Open mosyp opened 2 years ago

mosyp commented 2 years ago

We don't want to waste resources with dead_letters table and s3/dynamodb clients. Thus, it makes more sense to create/close those resources on demand

mosyp commented 2 years ago

cc @xianwill