search

invinst / invisible-flow

9 stars 2 forks source link

Load the data into a database(FOIA) #13

Open adesca opened 5 years ago

adesca commented 5 years ago

GIVEN that the data has been transformed AND the transformed data is under [timestamp]\transformed THEN it should be loaded into the database AND it should add new rows to the database BUT it should not modify the database when the transformed data conflicts with an existing database row based on the UNIQUE KEY

Conflicts are handled in issue #14

To clarify, when there is a database conflict a new row should NOT be added and nothing should happen.

This should be done for each of the dataset types defined in the definition for "foia response"

adesca commented 5 years ago

Linked are the sqlalchemy models used by the database.