The python script influx_metrics_univ3_parallel.py uses pystable which has an unidentified memory leak. To get around that, the shell script influx_metrics_univ3.sh will be called periodically to kill and restart the python script (periodic calls through crontab).
To keep things consistent, the python script for pulling cumulatives is also being called through a shell script now and can be killed through a shell script too.
The shell scripts also:
make it easy to read environment variables and
run python scripts in a poetry env without explicitly running the shell script in a poetry shell
Next step is to capture and structure the logs produced by these scripts.
The python script
influx_metrics_univ3_parallel.py
uses pystable which has an unidentified memory leak. To get around that, the shell scriptinflux_metrics_univ3.sh
will be called periodically to kill and restart the python script (periodic calls through crontab).To keep things consistent, the python script for pulling cumulatives is also being called through a shell script now and can be killed through a shell script too.
The shell scripts also:
Next step is to capture and structure the logs produced by these scripts.