Personal MCFD Onboarding Step 2 - Requests DOCUMENTS Migration

[abin-aot]

Title of ticket:

Description

The purpose of this task is to migrate the correspondence logs, attachments and documents related with data migrated on #4140, for X numbers of personal MCFD requests .

Dependencies

Are there any dependencies?

• @lmullane , @m-prodan , @liseandtea , @JHarrietha-AOT : There is no division tags on AXIS hence we need to create a generic division for MCFD to migrate the document and tag with it. This will be a task in between #4140 and #4142

DOD

• [x] Plan, Develop correspondence log message conversion/create to PDF - indication of related attachments is required
• [x] Stitching of individual PDF pages - Document Review Log and others Document Logs
• [x] Refer POC and develop thread safe code Document Upload to S3 - a generic function depending on the AXIS Request number - Maintain existing gathering records folder structure and tag with a generic division tag
• [x] Develop a dedupe message generation logic to dedupe documents uploaded on Gathering records
• [ ] Insert Metadata to FOI FLOW , FOI DOCUMENT REVIEWER DBs to maintain relational data structure for FOI requests to do further operations ahead. Correspondence log goes to Attachments tab and rest of the document types go to records tab.
• [ ] Validate Data migration for few FOI requests - Say 5-6 - Personal , General - Sanity check with Business

[abin-aot]

Lets start with 21 points for now! - There are chances to increase depends on the Generic division tagging, interim stitching etc.

[lmullane]

All Correspondence Log documents migrated into FOI Mod should not viewable by the ministry coordinator (i.e., apply the applicant tag to these documents).

[abin-aot]

As discussed with @lmullane , and business , we are logically ending this task and its predecessor(#4140) due to following reasons.

1. Our earlier assumptions like tagging records with a single placeholder division for CFD personals wont be effective, since those Analysts heavily rely on the sections aka tags for documents . cc: @m-prodan , @liseandtea , @KyEggleston
2. Because of the above reason we need to complete newly created USs first i.e. related to Sections for CFD to do the migration
3. Also, Strategy of the migration need to finalized once we have a clear on how the Analysts are onboarded for CFD personal - Bulk or Adhoc.