SFTP Unzipping

[scleary1cs]

Story

As a CA, so that my HL7 messages can be read, I need the SFTP service to unzip and apply a password to access the messages.

Pre-conditions

• [ ] #1077 is complete.

Acceptance Criteria

• [ ] Zip files read from external SFTP server are put into a special subfolder in Azure bucket.
• [ ] Unzip the file in the special subfolder and write the messages into the processing subfolder.

Tasks

Research

• [x] We need to get our hands on a test password protected zip file from CA @JohnNKing.

Engineering

• [ ] Caching bearer token, and then monitor JWT/bearer token for expiration For CA, we're receiving one zip file per day and then sending many (dozens? hundreds?) of requests to report stream. Are there any issues with getting a new token for each of those calls? Not sure how soon we need to tackle caching the token

Definition of Done

• [ ] Documentation tasks completed
  • [ ] Documentation and diagrams created or updated
  • [ ] Implementation guide (/ig folder)
  • [ ] ADRs (/adr folder)
  • [ ] Main README.md
  • [ ] Other READMEs in the repo
  • [ ] If applicable, update the ReportStream Setup section in README.md
  • [ ] Threat model updated
  • [ ] API documentation updated
• [ ] Code quality tasks completed
  • [ ] Code refactored for clarity and no design/technical debt
  • [ ] Adhere to separation of concerns; code is not tightly coupled, especially to 3rd party dependencies
  • [ ] Code is reviewed or developed by pair; 1 approval is needed but consider requiring an outside-the-pair reviewer
  • [ ] Code quality checks passed
• [ ] Security & Privacy tasks completed
  • [ ] Security & privacy gates passed
• [ ] Testing tasks completed
  • [ ] Load tests passed
  • [ ] Unit test coverage of our code >= 90%
• [ ] Build & Deploy tasks completed
  • [ ] Build process updated
  • [ ] API(s) are versioned
  • [ ] Feature toggles created and/or deleted. Document the feature toggle
  • [ ] Source code is merged to the main branch

Research Questions

• Optional: Any initial questions for research

Decisions

• Optional: Any decisions we've made while working on this story

Notes

1.  Password entry mysteries
2. Do the unzipping

[scleary1cs]

Should we add decrypting to the AC? @halprin @somesylvie @jcrichlake

[halprin]

Should we add decrypting to the AC? @halprin @somesylvie @jcrichlake

We could represent this as a precondition stating that the Zip file is password protected.