niaid / image_portal_workflows

Workflows related to project previously referred to as "Hedwig"
BSD 3-Clause "New" or "Revised" License
5 stars 1 forks source link

consider modifying logging behavior #461

Closed philipmac closed 5 months ago

philipmac commented 5 months ago

V large input sets can generate very large logs. This can, among other things, trigger firewalls and halt workflows. eg: https://github.com/niaid/image_portal_workflows/issues/459

If log level could be modified, and/or log behavior could be modified (eg what logs get posted back to prefect server, what get left on local runner machine etc).

philipmac commented 5 months ago

duplicate https://github.com/niaid/image_portal_workflows/issues/460 - closing