BroadSoft-Xtended / BroadWorks-Dashboards-and-Discovery

This repository contains the BroadWorks Dashboards and Discovery components to extend BroadWorks data mining, reporting, and analysis capabilities.
23 stars 4 forks source link

Partition with Key in Kafka, from bwlogsender #100

Open ziaf000 opened 4 years ago

ziaf000 commented 4 years ago

Hi,

I need to stream the AS logs, from Kafka to other system. as of now its 10 partition per topic.

I am having an requirement of sending the logs in order as it gets generated. for example, in Audit logs, writeID gets generated, as of now, Audit logs is being pushed to random partition. When consumer read the data from KAFKA topic, its order gets disturbed.

Is it possible if at bwlogsender end, all Audit logs go to one partition, like wise all PS logs in other partition and so on. same goes from XSP, NS and others.

Please suggest if this changes could be done. I would be very thankful. !!