HSLdevcom / transitlog

Explore observed public transport and compare with the intended traffic
https://reittiloki.hsl.fi/
Creative Commons Attribution 4.0 International
5 stars 1 forks source link

Write pulsar-http-post-sink #7

Open haphut opened 5 years ago

haphut commented 5 years ago

Post GraphQL mutations into Hasura with the correct HTTP headers including credentials. Read the POST payloads from Pulsar. Store HTTP endpoint and public details as Docker configuration and credentials as Docker secrets, not in Pulsar.

Post only one HTTP request at a time before acking on the Pulsar topic so that TimescaleDB is updated in chronological order. That makes it significantly easier for transitlog-ui to rely on GraphQL subscriptions.

Implement using Pulsar IO.

paasovaara commented 5 years ago

https://github.com/HSLdevcom/transitlog-hfp-source