delta-io / kafka-delta-ingest

A highly efficient daemon for streaming data from Kafka into Delta Lake
Apache License 2.0
359 stars 79 forks source link

Add special env var for JSON formatted sasl/scram #119

Closed xianwill closed 2 years ago

xianwill commented 2 years ago

This PR adds special handling for a SASL/SCRAM username/password JSON environment variable. This is useful when using AWS MSK SASL/SCRAM authentication due to the requirement that username/password be stored as a single JSON object in Secrets Manager.