Data management - Githubissues

ess-acppo / ag-bie

This repository has the code to the agriculture's implementation of ALA BIE

1 stars 4 forks source link

Data management #5

Closed ess-acppo-djd closed 4 years ago

ess-acppo-djd commented 6 years ago

A records management strategy (backup/archive/disposal) is required to deal with the various inputs and outputs to/from ag-BIE.

(This issue is a work in progress. This comment will be removed when it is deemed to be fully documented)

Known inputs:

NAQS data files stored in /home/dawr These files are pushed to the server by an automated process managed by ISD Import Systems. They accumulate indefinitely with no automated archiving or disposal. Four files are provided each day.
- tblBiota_yyyymmdd.csv
- tblBiotaAssociate_yyyymmdd.csv
- tblBiotaCount_yyyymmdd.csv
- tblCommonName_yyyymmdd.csv Only tblBiota and tblCommonName are used by ag-BIE.

moziauddin commented 4 years ago

These files are now backing up to S3 bucket.