Hasurino can't keep up with mqtt feed

HSLdevcom / transitlog

Explore observed public transport and compare with the intended traffic

https://reittiloki.hsl.fi/

Creative Commons Attribution 4.0 International

5 stars 1 forks source link

Hasurino can't keep up with mqtt feed #12

Closed paasovaara closed 5 years ago

paasovaara commented 5 years ago

Immediately after starting the process hasurino starts printing out these in production:

2019-01-07T13:34:12+00:00 localhost.localdomain 13550f816cda[1135]: 2019-01-07T13:34:12.012Z hasurino.processor: WARNING: Currently hasurino might not be able to handle the MQTT volume as in_queue is full

paasovaara commented 5 years ago

If the queues block each other than this would indicate that one of the threads is a bottleneck. perhaps insertion? Can that be done async?

paasovaara commented 5 years ago

will not fix, hasurino is EOL