Hurence / logisland

Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Streams (Flink being in the roadmap). The platform does complex event processing and is suitable for time series analysis. A large set of valuable ready to use processors, data sources and sinks are available.
https://logisland.github.io
Other
110 stars 28 forks source link

Add include mechanism in the yaml for pipelines #549

Open lhubert opened 4 years ago

lhubert commented 4 years ago

Expected behavior and actual behavior.

yaml files become very large and are difficult to read. Having an include mechanism would make things more modular and easy to manage. We would also have a better re-usability of common configs.

Steps to reproduce the problem.

Specifications like the version of the project, operating system, or hardware.