search

airtai / fastkafka

FastKafka is a powerful and easy-to-use Python library for building asynchronous web services that interact with Kafka topics. Built on top of Pydantic, AIOKafka and AsyncAPI, FastKafka simplifies the process of writing producers and consumers for Kafka topics.
https://fastkafka.airt.ai
Apache License 2.0
41 stars 2 forks source link

Support for other protocols (AWS SQS, google cloud pubsub, RabbitMQ, ..) #17

Open davorrunje opened 1 year ago

davorrunje commented 1 year ago

I really like the idea of this, as the biggest gripe I have with most pub/sub solutions is all of the tedious boiler plate code needed to correctly subscribe and publish and manage message leases etc. While you often just want to grab a message, do some processing and put it on a different queue.

One of the most obvious improvements would be supporting more pubsub backends (thinking about AWS SQS, google cloud pubsub, RabbitMQ, ...)

https://www.reddit.com/r/Python/comments/11paz9u/comment/jbxf1v8/?utm_source=share&utm_medium=web2x&context=3

davorrunje commented 1 year ago

Very cool indeed. Currently at work we're using RabbitMQ for messaging so this doesn't apply to us (for now), but this type and style of implementation is exactly what I would expect when searching for libs like this. Great job!

https://www.reddit.com/r/Python/comments/11paz9u/comment/jbxbbxp/?utm_source=share&utm_medium=web2x&context=3

davorrunje commented 1 year ago

is there something like this for pulsar?

https://www.reddit.com/r/Python/comments/11paz9u/comment/jbyl5us/?utm_source=share&utm_medium=web2x&context=3