Archive all data in GCS

deployment-gap-model-education-fund / deployment-gap-model

ETL code for the Deployment Gap Model Education Fund

https://www.deploymentgap.fund/

MIT License

6 stars 2 forks source link

Archive all data in GCS #313

Open bendnorman opened 3 months ago

bendnorman commented 3 months ago

Data from gs://dgm-archive is downloaded to data/data_cache while the other smaller datasets are stored on Github in data/raw. It would be nice for consistency's sake to just store everything in GCS.