Creates a new class, WorkerLogger, with a variety of methods related to logging, including one to push logs to GCP
Creates a second class, MemoryMonitor, that opens a process on a new thread to monitor memory usage, logs usage stats, and logs a warning if system memory usage exceeds 75%
Adds logging to worker runs, including accessing of worker and job IDs
Refactors compute_general_economy to make it easier to embed a logger into its operations
Fixes #1947. This code:
WorkerLogger
, with a variety of methods related to logging, including one to push logs to GCPMemoryMonitor
, that opens a process on a new thread to monitor memory usage, logs usage stats, and logs a warning if system memory usage exceeds 75%compute_general_economy
to make it easier to embed a logger into its operations