Automate cog transformation

NASA-IMPACT / veda-data-airflow

Airflow implementation of ingest pipeline for VEDA STAC data

Other

10 stars 4 forks source link

Open SwordSaintLancelot opened 2 months ago

SwordSaintLancelot commented 2 months ago

Summary: Create a DAG that would allow us to transform the dataset files with minimal effort.

Create the Python scripts to fetch the data, transform the data into COGs, and push them to the S3 bucket
Create a DAG to automate the given process.
Test the process on multiple datasets