search

mozilla-services / heka

DEPRECATED: Data collection and processing made easy.
http://hekad.readthedocs.org/
Other
3.39k stars 531 forks source link

Support for recursive configuration directory #1901

Open donjohnson opened 8 years ago

donjohnson commented 8 years ago

Currently when specifying a configuration directory (say, /etc/heka/conf.d), it will only load the files in that directory. With larger installations, especially those supporting "pluggable" input/filter combinations, it would be nice to be able to organize these files into directories, so we could have something like this, where a base setup of decoders and a sink output exists, as well as a central processor ready to handle the output of any plugins in the extras directory:

conf.d
├── base
│   ├── decoders.conf
│   ├── filter_main_metrics_processor.conf
│   ├── input_tcp.conf
│   └── output_elasticsearch.conf
└── extras
    ├── monitor_endpoint_performance
    │   ├── filter_endpoint_metrics.conf
    │   └── input_logstreamer_access_log.conf
    └── monitor_failed_logins
        ├── filter_failed_logins.conf
        └── input_logstreamer_audit_log.conf