bcgov / nr-rfc-grib-copy

Demo of using github actions to copy / process raw data
Apache License 2.0
2 stars 2 forks source link

Reduce memory footprint #29

Open franTarkenton opened 1 year ago

franTarkenton commented 1 year ago

pods started failing recently when they ran out of allocated memory. This happens when the data in the cache grows, which may happen, but is likely an indicator that either events are not getting received/emitted that we are expecting.

Investigate how the startup of the pod / listener checks for cached events to determine if it could be handled in a more memory efficient way.

If so monitor memory utilization of the pod after changes and modify the deployment to use only the amount of memory required.