search

thatdot / quine

Quine • a streaming graph • https://quine.io • Discord: https://discord.gg/GMhd8TE4MR
https://quine.io
Other
295 stars 39 forks source link

Connection to Apache Pulsar #24

Open hpvd opened 1 year ago

hpvd commented 1 year ago

Beside the well-known and already connected Kafka, Apache Pulsar (https://github.com/apache/pulsar#readme) really looks like another rewarding candidate for a connection (read and write to topics) It has interesting features out of the box like easy to scale, persistence, georeplication, lambda like functions, is already connected to several other apps (source/sink) see https://pulsar.apache.org/docs/2.10.x/io-connectors/ and seems to grow pretty fast https://pulsar.apache.org/blog/2022/05/11/apache-pulsar-community-welcomes-500th-contributor/

In July 2022 it seems to have also the highest number of pull requests in the field of messaging/streaming tech - even more than Kafa https://www.youtube.com/watch?v=ckfw68-cn2o

-> would be really exiting what one can build/which new user groups could be attracted by make it easy to combine Quine and Pulsar :-D

2022-11-27_20h25_31

stevenbenjamin commented 1 year ago

There is a pulsar ingest defined here, (see under Body, e.g. alternate selection to File Ingest Stream). That being said, would love to get more input on what options people would like to see here for Pulsar connectivity.