search

MetPX / sarracenia

https://MetPX.github.io/sarracenia
GNU General Public License v2.0
46 stars 22 forks source link

direct support for Azure Service bus? #612

Open petersilva opened 1 year ago

petersilva commented 1 year ago

perhaps make a moth module based on these examples:

https://github.com/Azure/azure-sdk-for-python/blob/main/sdk/servicebus/azure-servicebus/samples/sync_samples/send_topic.py

Conceptual problem: Topics, are Kafka-style fixed topics, more analogous to AMQP exchanges. no concept of hierarchy.

petersilva commented 1 year ago

discussed this with a client, likely easiest approach for him currently is to combine the above example with the moth subscriber included with sarracenia... but it might be worthwhile to add Azure (aws equivalent) and Kafka support.

petersilva commented 1 year ago

this is spawned from #609 ... client is currently extending the moth example to act as a shovel to an Azure bus. I would think it would be straight-forward, but a little more work, to add support as a moth class for Azure Service bus... and that way, future users would need no code at all (just a shovel with an amqps:// broker url on the source side, and an azure://... broker url on the destination side.