18F / identity-analytics-etl

ETL and SQL scripts for Login.gov data warehouse and business intelligence
10 stars 6 forks source link

SPIKE: how to move off of production db #192

Closed lauraGgit closed 5 years ago

lauraGgit commented 5 years ago

User story

As a user, I would like to not have my information manipulated, so that I can trust login.gov.

Notes

What is the value to the user in this story?

What are things we should consider when making this story

Acceptance Criteria

MacHu-GWU commented 5 years ago

Available Solution:

@lauraGgit the DB is more about Devops work (I think the DBA is part of our Devops team), we need a meeting with Devops.

lauraGgit commented 5 years ago

@MacHu-GWU can you say a bit more about what you mean about "*DP app not first reading / writing from it"?

MacHu-GWU commented 5 years ago

@lauraGgit, Separate Read / Write is a common strategy to balance the workload. For example a db cluster usually have 3 notes a, b, c. We assume that for write (app try with node a first, if failed then try node ), and for read, for redundant. When there is a write operation, it goes to , and new data is eventually available (see the AWS RDS internal implementation doc) from , then .

My point is, analytics may query from (with data delay), but App prefer read from than .