Oracle ETL pipeline, allowing for data synchronization with Oracle db

[acoard-aot]

Includes

• OpenShift dev/test/prod ETL pipeline
• Ability to transform all data from postgres back to Oracle, and vice versa, must be bidrectional
• Ability to schedule jobs, or run it "live", depending on what requirements we identify.

TODO, breakdown task for/with Jaise:

• Get Oracle connection on local machine - haley
• Getting Oracle<->OCP access - also to MS Access
• Meetings for Oracle/MS access, generate certs?
• Technical decisions

Steps for SITE, but unsure if same for CATS:

1. Data Custodian Approval email is needed, for SITE it would be either Alan or Karen (https://a100.gov.bc.ca/int/irs/viewApplication.do?name=SITE) as per IRS.
2. once the ticket is raise the DBA will setup the encrypted listeners on 1543 for that proxy account
3. Then the dev team and DBA co-ordinates manually for the certs as outlined in that Github link.
4. The team which wrote that wiki page has moved from Typescript/Node.js to Spring Boot/Java for removing manual work , so things might be outdated

[jaise-aot]

completed PoC with SymmetricDS. Data from a sample PostgreSQL db is getting replicated accurately in Oracle 12c target database.

[jaise-aot]

PoC started with Airbyte. Setup Airbyte on my local. Establishing connectivity with source and targets in my local.