treasure-data / omnibus-td-agent

td-agent (Fluentd) Packaging Scripts
https://docs.treasuredata.com/articles/td-agent-changelog
Apache License 2.0
82 stars 131 forks source link

Regarding management of senstive information in td-agent.conf file #272

Open pratikshavyas opened 4 years ago

pratikshavyas commented 4 years ago

Our requirement is to have all the files which contain sensitive information encrypted. As td-agent.conf file contains sensitive credential information as plain text we have to encrypt this file as well. We are following the below approach:

  1. Start service
  2. Check if process started running
  3. Encrypt the config file. However, with this approach there is an issue as when a worker goes down and starts again as part of supervisor, it tries to read the conf file again but since file is encrypted it is failing to come up. This complexity increases with multiple workers since all workers start independently in parallel and we do not know when to encrypt and decrypt. Please share any solution to achieve this.

Thanks in advance.