teslamotors / fleet-telemetry

Apache License 2.0
655 stars 73 forks source link

Kafka partition support for scaling #169

Closed stx closed 4 months ago

stx commented 4 months ago

We have too many vehicles to make 1 partition <> 1 consumer work.

I've implemented a manual solution for multi-partition support, but it'd be really good for others if the partition count was configurable. I looked for a way to do this but didn't find any obvious way.

KirigiriSuzumiya commented 3 months ago

anything going on with this? looking for answer to same issue

KirigiriSuzumiya commented 3 months ago

anything going on with this? looking for answer to same issue