Closed EricTurner3 closed 3 years ago
New etl scripts interface with both the datasets repo and the data-intake repo.
datasets
data-intake
Currently, it will search for an agency & dataset, and add a new dataset if missing.
However, there are no checks on the data-intake, for now it just simply inserts all good data.
New etl scripts interface with both the
datasetsrepo and thedata-intakerepo.Currently, it will search for an agency & dataset, and add a new dataset if missing.
However, there are no checks on the
data-intake, for now it just simply inserts all good data.