feat: add new directory structure and update prefixes

NASA-IMPACT / veda-data

2 stars 0 forks source link

feat: add new directory structure and update prefixes #121

Closed botanical closed 1 month ago

botanical commented 1 month ago

Changes

New directory structure created following:

ingestion_data/

Collections (automated validation on pr)

/staging

    /discovery-items

    /dataset-config

/production

    /discovery-items

Staging and Production discovery-items have been updated so that prefixes match the collection
/production/discovery-items updated so that the bucket is veda-data-store

smohiudd commented 1 month ago

The staging prefixes shouldn't be changed since they still need to reference the prefixes in veda-data-store-staging. Only need to change prefixes for production discovery-items

botanical commented 1 month ago

The staging prefixes shouldn't be changed since they still need to reference the prefixes in veda-data-store-staging. Only need to change prefixes for production discovery-items

https://github.com/NASA-IMPACT/veda-data/pull/121/commits/7e7505fb9755c78f9a3ebcea1686379f3acb747b @smohiudd thanks! it's been updated now