Hurence / logisland

Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Streams (Flink being in the roadmap). The platform does complex event processing and is suitable for time series analysis. A large set of valuable ready to use processors, data sources and sinks are available.
https://logisland.github.io
Other
110 stars 28 forks source link

Rework the controller service or whatever to support multiple Avro schemas in a single topic #535

Open lhubert opened 4 years ago

lhubert commented 4 years ago

Expected behavior and actual behavior.

For the free open analytics subscription we need to minimize costs using a single topic where all web events for all web sites of non paying customers will flow. Therefore the open analytics logisland pipeline needs to cope with multiple Avros schemas.

Steps to reproduce the problem.

Currently on one Avro schema is used in the logisland pipelines

Specifications like the version of the project, operating system, or hardware.