Externalize connection config

slingdata-io / sling-cli

Sling is a CLI tool that extracts data from a source storage/database and loads it in a target storage/database.

https://docs.slingdata.io

GNU General Public License v3.0

385 stars 25 forks source link

Open trung opened 3 weeks ago

trung commented 3 weeks ago

Connection config usually contains credentials which is not ideal to store in file system (i.e: sling's env.yaml).

It would be awesome if sling could externalize the connection config.

Something like below:

connections:
  my_db:
    config_url: <value>

Where config_url value could be:

aws://secretsmanager?arn=arn:aws:secretsmanager:us-east-1:1111222233334444:secret:mydb&key_prefix=sling
https://some_config_server/mydb
file://path/to/config/file

flarco commented 3 weeks ago

Interesting, thanks for the suggestion.

It's worth mentioning that sling accepts env var SLING_ENV_YAML (just put the whole yaml body in the env var).