HSLdevcom / transitlog

Explore observed public transport and compare with the intended traffic
https://reittiloki.hsl.fi/
Creative Commons Attribution 4.0 International
5 stars 1 forks source link

Write pulsar-mqtt-source #4

Closed haphut closed 5 years ago

haphut commented 5 years ago

https://github.com/HSLdevcom/pulsar-mqtt-source

Collect any MQTT data into Pulsar. Run several instances for high availability.

Use a list of MQTT topic filters in the configuration to collect all MQTT data from VPCs into one topic. The ordering of the messages within the vehicle and in relation to other vehicles matters when the vehicle clocks cannot be trusted.

Implement using Pulsar IO.

Do not run within the Pulsar cluster. Use either Pulsar Java Admin API or Pulsar Admin CLI to run locally on Docker host / Docker Swarm.

paasovaara commented 5 years ago

https://github.com/HSLdevcom/mqtt-pulsar-gateway implements this.