Feature automate data transformation

[SwordSaintLancelot]

Description

This PR is part of this PR. To separate the VEDA and GHG environment we separated the transformation plugins that are to be used by the SM2A DAG. This PR creates a folder for the plugins which are pushed to GHG specific AWS account. The DAG will then fetch the transformation plugin to transform the netCDF files toCOGs Tasks accomplished-:

• [x] Created plugins for older datasets (Sedac population, OCO2-Geos, Ecco-Darwin, TM5 inverse flux)
• [x] Created plugin for a new dataset (GOSAT-CH4)
• [x] Tested the delivery of plugins to S3 bucket (only if the plugin does not exist on S3)
• [x] Ran the DAG to test out the transformation of the new dataset.

[github-actions[bot]]

PR Preview Action v1.4.8 :---: :rocket: Deployed preview to https://US-GHG-Center.github.io/ghgc-docs/pr-preview/pr-137/ on branch gh-pages at 2024-11-20 16:03 UTC

[review-notebook-app[bot]]

Check out this pull request on 

See visual diffs & provide feedback on Jupyter Notebooks.

---

Powered by ReviewNB

[siddharth0248]

@amarouane-ABDELHAK is this ok to be merged ?

[amarouane-ABDELHAK]

I will be reviewing it today. In the meantime, could you add the missing newlines?

[SwordSaintLancelot]

@amarouane-ABDELHAK what do you mean by newlines?