Within the docker images the logging gets outputted into console, this ends up in the docker log.
For the ETL images this is triggered by supercronic and the logs get wrapped in supercronics logs, making it hard to read as there is too much meta-data.
This ticket should look at improving the logging.
Acceptance Criteria
Logs are preserved when docker containers get deleted/rebuilt
Logs are separated by service
logs are separated by day
This covers the two ETL scripts and the API
Tests will be a manual verification that the logs are stored on the linux machine and persist when redeploying the docker images.
Within the docker images the logging gets outputted into console, this ends up in the docker log.
For the ETL images this is triggered by supercronic and the logs get wrapped in supercronics logs, making it hard to read as there is too much meta-data.
This ticket should look at improving the logging.
Acceptance Criteria
Tests will be a manual verification that the logs are stored on the linux machine and persist when redeploying the docker images.