bcgov / PIMS

Property Inventory Management System
https://pims.gov.bc.ca
Apache License 2.0
47 stars 43 forks source link

PIMS-1768: Updated DBeaver ETL task for Dev/Test/Prod #2458

Closed LawrenceLau2020 closed 3 months ago

LawrenceLau2020 commented 3 months ago
## 🎯 Summary [PIMS-1768: ](https://citz-imb.atlassian.net/browse/PIMS-1768)

Tried changing the port of the existing localhost postgres database connection to use the remote OC dev postgres database, but then all the table mapping gets mismatched for some reason.

Created an new ETL task, "PIMS ETL Prod to Dev" for running against Dev, Test, and Prod Openshift environments because it doesn't seem that DBeaver allows you to use the same database task against multiple databases.

image

I also, included a "data-sources.json" file which should include the connection string that the new ETL task uses, you probably will need to enter the db name, username and password, port number should be 127.0.0.1:22224. image

I also removed 2 older ETL tasks that were outdated, so you should now only see these 2 tasks, one for running locally and the other one for running against the Openshift environments.

🔰 Checklist

  • I have performed a self-review of my code.
  • I have commented my code, particularly in hard-to-understand areas.
  • I have made corresponding changes to the documentation where required.
  • I have tested my changes to the best of my ability.
  • My changes generate no new warnings.