world-federation-of-advertisers / cross-media-measurement

A privacy centric system for cross publisher, cross media ads measurement through secure multiparty computations.
https://halo.wfanet.org/
Apache License 2.0
36 stars 11 forks source link

ci: Read Spanner processing units from GitHub environment #1856

Closed SanjayVas closed 1 month ago

SanjayVas commented 1 month ago

Different Halo test environments have different Spanner resource needs. For example, the head environment tends to have much lower traffic compared to the qa environment. Spanner autoscaling only supports whole nodes (multiples of 1000 processing units), whereas some test environments are often idle and do not need a whole node. Spanner nodes are relatively expensive (currently $657/month for the us-central1 region).

This also removes the specification of 100 processing nodes for the example Terraform configuration, as that is far below Spanner recommendations.

wfa-reviewable commented 1 month ago

This change is Reviewable