Update logging - Githubissues

niaid / image_portal_workflows

Workflows related to project previously referred to as "Hedwig"

BSD 3-Clause "New" or "Revised" License

5 stars 1 forks source link

Update logging #460

Open annshress opened 5 months ago

annshress commented 5 months ago

Large number of inputs might be generating bigger logs (> 8KB).

In order to handle this, logging should be divided into two parts.

Logs that is sent to the prefect server + locally saved logs (should tend to be small)
Logs that are locally saved only (can be detailed and verbose)

Inspiration: https://github.com/niaid/image_portal_workflows/issues/459 Reference: https://docs.aws.amazon.com/waf/latest/developerguide/aws-managed-rule-groups-baseline.html#aws-managed-rule-groups-baseline-crs