SOC2 - GN-122 How do we address autoscaling to guarantee headroom

sourcegraph / sourcegraph-public-snapshot

Code AI platform with Code Search & Cody

https://sourcegraph.com

Other

10.12k stars 1.29k forks source link

SOC2 - GN-122 How do we address autoscaling to guarantee headroom #29590

Closed JenRed777 closed 2 years ago

JenRed777 commented 2 years ago

Due: February 15, 2022

Sourcegraph continuously assesses system requirements and capacity needs to plan for system changes required to support service commitments.

Notes: Autoscaling with guaranteed headroom; if you onboard a new big client, will that cause a disruption? How are we planning to avoid this?

JenRed777 commented 2 years ago

For Managed Instances: The Delivery team is notified when system capacity has been reached. If we need to scale the system there is downtime that will occur. The downtime is similar to what is seen during a version upgrade.

danieldides commented 2 years ago

Ready for review: https://docs.google.com/document/d/1fy-tD637Lmh6y9uX8DD8Ud1I8FpoiyBwjlsVdteopCg

daxmc99 commented 2 years ago

@danieldides Might be a good idea to add GCP Quota alerts as part of this? https://sourcegraph.com/github.com/sourcegraph/infrastructure/-/blob/buildkite/quota.tf?L6:44

JenRed777 commented 2 years ago

Document looks good but I agree we should add the quota alerts as well. @danieldides is this something you can take care of?

danieldides commented 2 years ago

Updated the document with a small blurb and screenshot of quotas.

JenRed777 commented 2 years ago

LGTM