search

HSLdevcom / transitlog

Explore observed public transport and compare with the intended traffic
https://reittiloki.hsl.fi/
Creative Commons Attribution 4.0 International
5 stars 1 forks source link

Transform HFP into GraphQL mutations #6

Closed haphut closed 5 years ago

haphut commented 5 years ago

Transform HFP messages into GraphQL mutations. Implement using Pulsar Functions.

Possibly bundle Pulsar messages to send only e.g. 10 mutations/s into Hasura. Bundle e.g. at least every 100 ms or at most every 1000 messages, whichever condition is fulfilled first.

paasovaara commented 5 years ago

implemented using sql inserts to postgresql. this way insert speed is good enough, roughly 100ms for 1000 events (rows) in our sandbox server.

Using hasura was too slow.