Open S-AI-F opened 3 years ago
Once mapped json file stored in github repository is validated, you can update your mapping script by replacing input/output data with s3 buckets.
You have a specific folder by data source where you can put raw data and mapped generated data (in staging folder).
Doc:
data staging model: https://github.com/OpenGeoScales/ogs-connectors/wiki/2---Data-Model---Staging data staging storage: https://github.com/OpenGeoScales/ogs-connectors/wiki/Datalake-AWS-S3
Once mapped json file stored in github repository is validated, you can update your mapping script by replacing input/output data with s3 buckets.
You have a specific folder by data source where you can put raw data and mapped generated data (in staging folder).
Doc:
data staging model: https://github.com/OpenGeoScales/ogs-connectors/wiki/2---Data-Model---Staging data staging storage: https://github.com/OpenGeoScales/ogs-connectors/wiki/Datalake-AWS-S3