2562 describes an approach to use logging.handlers.FileHandler to create a log file for every datafile that is submitted and parsed. By default, this log file is not compressed, which could lead to extraneous disk and network usage.
Create a custom FileHandler or subclass the existing FileHandler to add compression to the resulting log file.
Acceptance Criteria:Create a list of functional outcomes that must be achieved to complete this issue
[ ] Per-file parsing log is compressed locally and in s3
[ ] Testing Checklist has been run and all tests pass
[ ] README is updated, if necessary
Tasks:Create a list of granular, specific work items that must be completed to deliver the desired outcomes of this issue
[ ] Create or subclass FileHandler to add compression
[ ] Run Testing Checklist and confirm all tests pass
Notes:Add additional useful information, such as related issues and functionality that isn't covered by this specific issue, and other considerations that will be helpful for anyone reading this
Note 1
Note 2
Note 3
Supporting Documentation:Please include any relevant log snippets/files/screen shots
Doc 1
Doc 2
Open Questions:Please include any questions or decisions that must be made before beginning work or to confidently call this issue complete
Description:
2562 describes an approach to use
logging.handlers.FileHandler
to create a log file for every datafile that is submitted and parsed. By default, this log file is not compressed, which could lead to extraneous disk and network usage.Create a custom
FileHandler
or subclass the existingFileHandler
to add compression to the resulting log file.Acceptance Criteria: Create a list of functional outcomes that must be achieved to complete this issue
Tasks: Create a list of granular, specific work items that must be completed to deliver the desired outcomes of this issue
FileHandler
to add compressionNotes: Add additional useful information, such as related issues and functionality that isn't covered by this specific issue, and other considerations that will be helpful for anyone reading this
Supporting Documentation: Please include any relevant log snippets/files/screen shots
Open Questions: Please include any questions or decisions that must be made before beginning work or to confidently call this issue complete