bcgov / nr-forest-client

FSA Forest Client
Apache License 2.0
3 stars 1 forks source link

FSADT1-305: Copy data from Oracle view to a local DB #19

Closed MCatherine1994 closed 2 years ago

MCatherine1994 commented 2 years ago

FSADT1-305 Copy data from Oracle view to a local DB

mamartinezmejia commented 2 years ago

This task was created to have an option in case the final user needs to query all data at once and have a better performance.

Option #1: Copy data to a local DB using NestJS, OpenShift and Postgres. We tried this but there were some challenges:

  1. If we query the whole data, JavaScript will get the browser frozen or the computer out of memory.
  2. If we compare the existing records with the ones in the Oracle DB, we get the following error because we must do this within a loop:

Error: connect ECONNREFUSED

Note: This error doesn’t happen if we do it outside of a loop.

Option #2: Copy data with other options.

Questions: