search

terraform-google-modules / terraform-google-cloud-datastore

Manages Datastore
https://registry.terraform.io/modules/terraform-google-modules/cloud-datastore/google
Apache License 2.0
22 stars 33 forks source link

Strategies for backing off RESOURCE_EXHAUTED quota 'Create or Delete Index Requests Per Minute` #22

Closed shermanericts closed 4 years ago

shermanericts commented 4 years ago

Hey there. First off, thank you for this really useful module. You guys have done a great job!

So I have an index.yaml of roughly 60 indicies. When running terraform apply I'll routinely hit this RESOURCE_EXHAUSTED quota.

...................failed.
ERROR: (gcloud.datastore.indexes.cleanup) RESOURCE_EXHAUSTED: Project sherman-test-removeme-26 exceeded its quota. Quota exceeded for quota metric 'Create or Delete index requests' and limit 'Create or Delete Index Requests Per Minute' of service 'datastore.googleapis.com' for consumer 'project_number:182326071841'.

I'm following up with our google support team to see if they can increase this for us at an organizational level. However, I'm wondering if you all have any strategies for backing off on the index creation requests.

For example, is it possible to pass in a map of indexes here and stagger the time that each index file would get created?

module "datastore" {
  source  = "terraform-google-modules/cloud-datastore/google"
  project = var.project
  credentials = var.credentials
  indexes = data.null_data_source.dependency.outputs.indexes
}

If not no worries. Any suggestions welcome.

Thanks again!

shermanericts commented 4 years ago

this is no longer an issue. was my environment. closing. thanks