search

manuzhang / awesome-streaming

a curated list of awesome streaming frameworks, applications, etc
https://manuzhang.github.io/awesome-streaming
2.59k stars 291 forks source link

Add SPAF (Java Stream Processing Abstraction Framework)? #73

Open nickshoe opened 1 month ago

nickshoe commented 1 month ago

Hi, as a thesis work I have developed a Java framework that provides an API that abstracts the programming (in a similar way to JPA, JNDI, etc...) of both stream processing engines (such as Apache Spark, Apache Storm, Apache Flink, and Apache Samza) and message brokers (such as RabbitMQ and Apache Kafka).

This is a work in progress and I think it is worth considering. I also hope to see this project developed further; giving it more visibility in this curated list would certainly help.

Here is the link to my repo on GitHub: https://github.com/nickshoe/spaf

manuzhang commented 1 month ago

Hi @nickshoe,

you may submit a PR for your project directly. Out of curiosity, as a user why shall I use your project instead of Apache Beam?

nickshoe commented 1 month ago

Hi @manuzhang, thanks!

I cannot tell you why, since I've never used Apache Beam before (I've only discovered its existence at the end of my thesis work). I will give it a try. For sure it's far more mature, but SPAF may offer a slightly different approach.

Let me ask you this: if it turns out that SPAF is just an alternative to Apache Beam, will you consider its inclusion in the list anyways?

manuzhang commented 1 month ago

@nickshoe I'll add your project to the list regardless