Create GCP Setup Script

mwvgroup / Pitt-Google-Broker

A Google Cloud-based alert broker for LSST and ZTF

https://pitt-broker.readthedocs.io/en/latest/index.html

4 stars 0 forks source link

Create GCP Setup Script #65

Open djperrefort opened 3 years ago

djperrefort commented 3 years ago

Create a single setup script that automates the creation of a new broker instance.

Most (if not all) of the setup for configuring the GCP back end for a new broker can be handled via gcloud. This includes creating a new project.

Setup script features

[ ] Include option to use an existing project
[ ] Include options to disable automatically enabling APIs
[ ] Echo status messages during setup procedure so user can track progress
[ ] Include verbose option for echoing all commands
[ ] Include quite options for echoing nothing
[ ] Add a CI test suite for ensuring the setup script works

troyraen commented 3 years ago

To be clear, this script already exists at broker/setup_broker/setup_broker.sh (ok, it's not a "single" script, since it calls other scripts, but it is the current script that automates the creation of a new broker instance). It uses gcloud commands for most things; the bulk of exceptions are in the setup_gcp.py script which uses python packages instead.

I agree that the script could use a makeover, and I had been wanting to re-write it using Cloud Build (as we recently discussed). Most of the features you describe above are not yet included in the script, and would be great improvements.

troyraen commented 3 years ago

It uses gcloud commands for most things

Ok, that's an over-statement... it's split about 50-50 with python calls.

troyraen commented 2 years ago

Linking to the Infrastructure Design notes from our recent meeting. See especially: Managing infrastructure as code with Terraform, Cloud Build, and GitOps