ioos / glider-dac

The IOOS Glider DAC site/scripts/tools
http://gliders.ioos.us/providers/
8 stars 13 forks source link

Restart services with possible memory leak #348

Closed benjwadams closed 2 weeks ago

benjwadams commented 1 month ago

A couple of services are slowly growing memory, seemingly without bound:

1) ERDDAP has a possible memory leak, as discussed here: https://groups.google.com/g/erddap/c/BHdELzgWf7o It's unclear why ERDDAP needs sometimes upwards of 32 GiB of memory.

2) Watchdog script show monotonically increasing memory consumption over time. This is possibly due to the very large number of inotify watches taken out, although the memory usage hasn't been profiled.

Currently as a workaround restarting at midnight on Sunday is proposed.

benjwadams commented 2 weeks ago

Implemented.