GoogleCloudPlatform / marketing-analytics-jumpstart

Marketing Analytics Jumpstart consists of an easy, extensible and automated implementation of an end-to-end solution that enables Marketing Technology teams to store, transform, enrich with 1PD and analyze marketing data, and programmatically send predictive events to Google Analytics 4 to support conversion optimization and remarketing campaigns.
Apache License 2.0
103 stars 35 forks source link

Quota rate limit exceeded #163

Open chmstimoteo opened 1 month ago

chmstimoteo commented 1 month ago
$> terraform apply

after changes in the dataform variables raise:

│ Error: Error when reading or editing Project Service maj-uat3/bigquery.googleapis.com: googleapi: Error 429: Quota exceeded for quota metric 'Read requests' and limit 'Read requests per minute' of service 'cloudresourcemanager.googleapis.com' for consumer 'project_number:764086051850'. │ Details: │ [ │ { │ "@type": "type.googleapis.com/google.rpc.ErrorInfo", │ "domain": "googleapis.com", │ "metadata": { │ "consumer": "projects/764086051850", │ "quota_limit": "ReadRequestsPerMinutePerProject", │ "quota_limit_value": "2400", │ "quota_location": "global", │ "quota_metric": "cloudresourcemanager.googleapis.com/read_requests", │ "service": "cloudresourcemanager.googleapis.com" │ }, │ "reason": "RATE_LIMIT_EXCEEDED" │ }, │ { │ "@type": "type.googleapis.com/google.rpc.Help", │ "links": [ │ { │ "description": "Request a higher quota limit.", │ "url": "https://cloud.google.com/docs/quota#requesting_higher_quota" │ } │ ] │ } │ ] │ , rateLimitExceeded │ │ with module.pipelines[0].module.project_services.google_project_service.project_services["bigquery.googleapis.com"], │ on .terraform/modules/pipelines.project_services/modules/project_services/main.tf line 31, in resource "google_project_service" "project_services": │ 31: resource "google_project_service" "project_services" { │ ╵ ╷ │ Error: Error when reading or editing Project Service maj-uat3/monitoring.googleapis.com: googleapi: Error 429: Quota exceeded for quota metric 'Read requests' and limit 'Read requests per minute' of service 'cloudresourcemanager.googleapis.com' for consumer 'project_number:764086051850'. │ Details: │ [ │ { │ "@type": "type.googleapis.com/google.rpc.ErrorInfo", │ "domain": "googleapis.com", │ "metadata": { │ "consumer": "projects/764086051850", │ "quota_limit": "ReadRequestsPerMinutePerProject", │ "quota_limit_value": "2400", │ "quota_location": "global", │ "quota_metric": "cloudresourcemanager.googleapis.com/read_requests", │ "service": "cloudresourcemanager.googleapis.com" │ }, │ "reason": "RATE_LIMIT_EXCEEDED" │ }, │ { │ "@type": "type.googleapis.com/google.rpc.Help", │ "links": [ │ { │ "description": "Request a higher quota limit.", │ "url": "https://cloud.google.com/docs/quota#requesting_higher_quota" │ } │ ] │ } │ ] │ , rateLimitExceeded │ │ with module.pipelines[0].module.project_services.google_project_service.project_services["monitoring.googleapis.com"], │ on .terraform/modules/pipelines.project_services/modules/project_services/main.tf line 31, in resource "google_project_service" "project_services": │ 31: resource "google_project_service" "project_services" { │ ╵ ╷ │ Error: Error when reading or editing Project Service maj-uat3/bigqueryconnection.googleapis.com: googleapi: Error 429: Quota exceeded for quota metric 'Read requests' and limit 'Read requests per minute' of service 'cloudresourcemanager.googleapis.com' for consumer 'project_number:764086051850'. │ Details: │ [ │ { │ "@type": "type.googleapis.com/google.rpc.ErrorInfo", │ "domain": "googleapis.com", │ "metadata": { │ "consumer": "projects/764086051850", │ "quota_limit": "ReadRequestsPerMinutePerProject", │ "quota_limit_value": "2400", │ "quota_location": "global", │ "quota_metric": "cloudresourcemanager.googleapis.com/read_requests", │ "service": "cloudresourcemanager.googleapis.com" │ }, │ "reason": "RATE_LIMIT_EXCEEDED" │ }, │ { │ "@type": "type.googleapis.com/google.rpc.Help", │ "links": [ │ { │ "description": "Request a higher quota limit.", │ "url": "https://cloud.google.com/docs/quota#requesting_higher_quota" │ } │ ] │ } │ ] │ , rateLimitExceeded │ │ with module.pipelines[0].module.project_services.google_project_service.project_services["bigqueryconnection.googleapis.com"], │ on .terraform/modules/pipelines.project_services/modules/project_services/main.tf line 31, in resource "google_project_service" "project_services": │ 31: resource "google_project_service" "project_services" { │ ╵ ╷ │ Error: Error when reading or editing Project Service maj-uat3/bigquerystorage.googleapis.com: googleapi: Error 429: Quota exceeded for quota metric 'Read requests' and limit 'Read requests per minute' of service 'cloudresourcemanager.googleapis.com' for consumer 'project_number:764086051850'. │ Details: │ [ │ { │ "@type": "type.googleapis.com/google.rpc.ErrorInfo", │ "domain": "googleapis.com", │ "metadata": { │ "consumer": "projects/764086051850", │ "quota_limit": "ReadRequestsPerMinutePerProject", │ "quota_limit_value": "2400", │ "quota_location": "global", │ "quota_metric": "cloudresourcemanager.googleapis.com/read_requests", │ "service": "cloudresourcemanager.googleapis.com" │ }, │ "reason": "RATE_LIMIT_EXCEEDED" │ }, │ { │ "@type": "type.googleapis.com/google.rpc.Help", │ "links": [ │ { │ "description": "Request a higher quota limit.", │ "url": "https://cloud.google.com/docs/quota#requesting_higher_quota" │ } │ ] │ } │ ] │ , rateLimitExceeded │ │ with module.pipelines[0].module.project_services.google_project_service.project_services["bigquerystorage.googleapis.com"], │ on .terraform/modules/pipelines.project_services/modules/project_services/main.tf line 31, in resource "google_project_service" "project_services": │ 31: resource "google_project_service" "project_services" { │ ╵

chmstimoteo commented 1 month ago

To workaround this issue, run terraform apply with -target options to deploy only specific modules.

Another possibility is to request a quota increase https://console.cloud.google.com/apis/api/cloudresourcemanager.googleapis.com/quotas