thegridelectric / gw-scada-spaceheat-python

GridWorks SCADA for space heating
MIT License
5 stars 2 forks source link

almond had problems uploading several days of status/snap #184

Open anschweitzer opened 1 year ago

anschweitzer commented 1 year ago
  1. It took a long time.
  2. almond crashed repeatedly with no info in log file. Did it use up too much memory? Top didn't show a lot in use.
  3. top showed it eating all cpu during upload.

Probably large upload should be a zip upload; but this scale shouldn't be this slow or crashy.

Total size of event directory was at least 33 MB, maybe 2k events, after about 4 days.

anschweitzer commented 1 year ago

@jessicamillar :

What do you think about having the SCADA not resending any messages until we’ve gotten some of our pipes cleaned?

@anschweitzer:

It’s trivial to reduce the amount of data it will resend, just a modification of the .env file. I already reduced it from 500 MB to 3 MB (I saw problems @ 30 MB, but they could happen sooner). I think there are one or two fixes we should do which are likely to be useful in any circumstance:

  1. Only send allow X messages in the pipe (right now we just flood the pipe).
  2. Don’t be optimistic - only send after ATN is attached.