SFTP Polling

[scleary1cs]

Story

As a CA, so that my files are picked up in a timely manner and I don't lock out users, I need the SFTP service to check for new files.

Pre-conditions

• [ ] #1077 is complete.

Acceptance Criteria

• [ ] New files are checked for on a ??? (predetermined) basis.
• [ ] New files are check for in a specific time window.
• [ ] When a new file is discovered, #1077 work will kick in.

Tasks

Research

• [ ] How often should we be checking for new files
• [ ] When (what time window) should we be checking for new files

Engineering

• [ ] Engineering work needed to complete the story
• [ ] Foundational: Technical runway work to support this and future efforts

Definition of Done

• [ ] Documentation tasks completed
  • [ ] Documentation and diagrams created or updated
  • [ ] Implementation guide (/ig folder)
  • [ ] ADRs (/adr folder)
  • [ ] Main README.md
  • [ ] Other READMEs in the repo
  • [ ] If applicable, update the ReportStream Setup section in README.md
  • [ ] Threat model updated
  • [ ] API documentation updated
• [ ] Code quality tasks completed
  • [ ] Code refactored for clarity and no design/technical debt
  • [ ] Adhere to separation of concerns; code is not tightly coupled, especially to 3rd party dependencies
  • [ ] Code is reviewed or developed by pair; 1 approval is needed but consider requiring an outside-the-pair reviewer
  • [ ] Code quality checks passed
• [ ] Security & Privacy tasks completed
  • [ ] Security & privacy gates passed
• [ ] Testing tasks completed
  • [ ] Load tests passed
  • [ ] Unit test coverage of our code >= 90%
• [ ] Build & Deploy tasks completed
  • [ ] Build process updated
  • [ ] API(s) are versioned
  • [ ] Feature toggles created and/or deleted. Document the feature toggle
  • [ ] Source code is merged to the main branch

Decisions

• Optional: Any decisions we've made while working on this story

Notes

1.  Do the polling for California.

[halprin]

Thoughts on how to do this: https://www.notion.so/flexion-cdc-ti/Polling-external-sites-d2b6037e13ee463e933d5e475b106ffb?pvs=4