search

haoch / flink-siddhi

A CEP library to run Siddhi within Apache Flink™ Streaming Application (Not maintained)
Apache License 2.0
243 stars 96 forks source link

Dynamically creating Siddhi Streams #47

Open aagupta1 opened 5 years ago

aagupta1 commented 5 years ago

Hi Haoch,

We are using Flink and Siddhi to build an alerting framework for the security domain.

One thing that we'd like to be able to do is create ad-hoc Siddhi streams based on the rule that a user defines - I want to be able to pull in fields from multiple input streams / schemas and create a new Siddhi stream on the fly which consists of the field names mentioned in the rule that the user created.

We've researched both Apache Eagle and the Flink-Siddhi project and from what we can tell, this is not supported functionality.

Any idea how we could achieve this ?

--Aarti

haoch commented 4 years ago

@aagupta1 I am not sure that if I got the point: you would like to have multiple existing streams with some fields, and would like to define another stream to extract fields from existing streams? Could you please share some use cases?