search

unity-sds / unity-analytics-bcdp

OGC compliant BCDP Deployment using CWL/Papermill
Apache License 2.0
0 stars 2 forks source link

As a SounderSIPS user, i want to regrid earth remote sensing data products #24

Open mike-gangl opened 1 year ago

mike-gangl commented 1 year ago

What data are required for executing this? Do we have it already? or is that a delivery as part of this ticket? Or is this going to external sources to get data (e.g. is this within BCDP already)

jjacob7734 commented 1 year ago

We propose to start with CMIP6 data (Earth system modeling suite consisting of many models on different grids that we can reproject to a common grid). For that use case, BCDP can search for that model data using the Papermill input parameters. It then reads the data into memory directly from S3 in the process step, so there is no need for stage in. That is the start because it is the most common way BCDP is used today. To make it more general, we'll follow that with regridding of some Sounder SIPS gridded products, but those are behind Earthdata login and require a token/credential for access. We'll need to assess whether we have a standard way to use that token in the ADES.