CIROH-UA / NGIAB-CloudInfra

NextGen In A Box: NextGen Generation Water Modeling Framework for Community Release (Docker version)
https://docs.ciroh.org/docs/products/nextgeninaboxDocker/
11 stars 16 forks source link

CIROH Google Cloud Functions for NWM WRF-Hydro Domain Subsetter #214

Closed fbaig closed 1 week ago

fbaig commented 3 weeks ago

1. Requester Information: This should include the name and contact information of the person making the request.

2. Project Information: The project aims to create a service to subset domain data version 3 for National Water Model WRF-Hydro model workflow. The data is already available and accessible on CIROH Google Cloud storage at gs://hydroshare-common-data.

3. Project Description: We plan to execute and possibly automate the R based domain subsetting code. Since the data is already available on Google Cloud storage, it is best to run the job on GCP resources instead of downloading the data on compute environment.

4. Resource Requirements: At this stage, we plan to investigate the feasibility of using GCP Cloud Functions for the above mentioned functionality. We will use docker to manage dependencies.

Options:

  1. Cloud Provider: AWS/Azure/GCP

    • GCP
  2. Required Services in the Cloud:

    • Google Cloud Functions

    List of GCP Services

    • Google Cloud Functions

5. Timeline: By next week i.e. 08/26/2024

6. Security and Compliance Requirements: N/A

7. Estimation: Not sure yet

8. Approval: Indicate the necessary approval processes or sign-offs required for the request.

ciroh-it-admin commented 2 weeks ago

@jameshalgren

arpita0911patel commented 2 weeks ago

@fbaig is there a way you could provide us the estimates for this runs on Google Cloud?