search

haoch / flink-siddhi

A CEP library to run Siddhi within Apache Flink™ Streaming Application (Not maintained)
Apache License 2.0
243 stars 96 forks source link

What are the advantages of siddhi over flink-cep #27

Open shidayang opened 5 years ago

shidayang commented 5 years ago

I don't konw how to chose siddhi and flink-cep

haoch commented 5 years ago

Some advantages:

haoch commented 5 years ago

@shidayang What's your use case?

panenming commented 5 years ago

dou you have example for (flink siddhi support dynamic cep runtime (modify ad-hoc without restart)) and can one stream apply to more than one dynamic ceps?

haoch commented 5 years ago

@panenming please have a look about https://github.com/haoch/flink-siddhi/blob/master/core/src/test/java/org/apache/flink/streaming/siddhi/SiddhiCEPITCase.java#L441 basically idea is image

you could send control event (Add/Deleted/Update) through ControlStream which physically could connect to some Kafka topic or other source and just send the control operation you want and it will apply to the DAG cep runtime dynamically.

Please refer to https://github.com/haoch/flink-siddhi/blob/master/experimental/src/main/scala/com/github/haoch/experimental/CEPPipeline.scala as a complete example

shidayang commented 5 years ago

@haoch thanks，I also have a question. can siddhi resolve unsort event?

haoch commented 5 years ago

@shidayang it doesn't have the concept of watermark in flink for out of order event, but it supports to keep some safe window for resorting events then process.

GithubZhitao commented 2 years ago

Hi @haoch. Although I haven't know all about siddhi, I am really absorbed by it. I have two questions:

  1. "flink siddhi support dynamic cep runtime" : Did you mean that one FLINK Job can run multi cep patterns distributed ?
  2. siddhi also has its own distribution plugin(https://github.com/siddhi-io/distribution). After I read the architecture document, I didn't find any description about the "exactly-once" or "watermark " or "event time, process time, session time" concepts. Can I say that FLINK did more than siddhi-distribution did?