Spinning up pangeo-forge Beam runner on AWS

hytest-org / AWS_Pangeo_Forge_Bakery

0 stars 0 forks source link

Spinning up pangeo-forge Beam runner on AWS #6

Open alaws-USGS opened 1 year ago

alaws-USGS commented 1 year ago

[x] Install Terraform with conda-forge
[x] Clone pangeo-forge-cloud-federation
[x] Configured S3 bucket for Terraform
[x] Update Terraform configuration in main.tf to point to bucket
[x] Ran terraform init
[x] terraform plan and instructions
[x] terraform apply
[ ]

lesliegarza commented 1 year ago

Load "variables.tf" and append "default = "pangeo-forgery" to the "region" variable.

rsignell-usgs commented 1 year ago

@yuvipanda merged a fix for the AWS flink deployment, so trying again:

$ terraform apply
var.cluster_name
  Name of EKS cluster to create

  Enter a value: esip-pangeo-forge
var.region
  AWS region to perform all our operations in.

  Enter a value: us-west-2

yuvipanda commented 1 year ago

@rsignell-usgs you can also copy the var file from here: https://github.com/yuvipanda/pangeo-forge-cloud-federation/blob/main/terraform/aws/bakeries/default-us-west-2.tfvars.

My original design thought was that multiple bakeries would be co-ordinated from that repo, as tfvars files. This is based off of the federated mybinder.org deploy model: https://github.com/jupyterhub/mybinder.org-deploy/tree/main/terraform. Allows all bakeries part of the federation to be kept in sync.