thegridelectric / gw-scada-spaceheat-python

GridWorks SCADA for space heating
MIT License
5 stars 2 forks source link

hw1-1.electricity.works went away around 7 PM 2023-01-27? #164

Open anschweitzer opened 1 year ago

anschweitzer commented 1 year ago

Almond log just reports many mqtt disconnect messages (1/minute), and doesn't connect. Ear is reporting nothing has been heard for an hour. Haven't checked orange yet. mosquitto_sub doesn't fail, but just seems to sit there. MQTT Explorer connect takes a long time then reports disconnected. gwd events show has last report at around 3PM.

jessicamillar commented 1 year ago

When I cleared the dummy_ear_queue (which had something like 800,000 messages) everybody started talking again. Unfortunately I did not first go to the overview page to inspect memory, but it seems likely that the dummy_ear_queue had clogged up our memory.

queues are not meant to be long on rabbit. The dummy ear queue is just for debugging, so maybe we could leave it in with a short queue if we want to take the time to figure out how to do that. For now I am deleting that queue

jessicamillar commented 1 year ago

Its interesting that gwd events show stopped at 3 pm but the ear didn't generate a nothing heard for the last hour until 7 pm. We should dig into that perhaps.