Considerations for horizontal scaling of Kafka Reporters

opentraffic / reporter

OTv2: distributed service that matches raw GPS probe data to OSMLR segments and sends anonymized speeds to Datastore

GNU Lesser General Public License v3.0

13 stars 16 forks source link

Considerations for horizontal scaling of Kafka Reporters #45

Closed dnesbitt61 closed 7 years ago

dnesbitt61 commented 7 years ago

Even if data is time-ordered there may be locking and contention issues with closely spaced GPS position data. It may be desirable to use Flink in between the Kafka records and the map-matching process within Reporter. Flink could be used to "buffer" single locations into traces.