search

GoogleCloudPlatform / marketing-analytics-jumpstart

Marketing Analytics Jumpstart consists of an easy, extensible and automated implementation of an end-to-end solution that enables Marketing Technology teams to store, transform, enrich with 1PD and analyze marketing data, and programmatically send predictive events to Google Analytics 4 to support conversion optimization and remarketing campaigns.
Apache License 2.0
103 stars 35 forks source link

Enable users to temporarily pause MAJ in their GCP project #66

Closed mansiparikh closed 3 months ago

mansiparikh commented 8 months ago

Received the following Google support in chat on how to pause MAJ in their GCP project to stop incurring processing and storage costs of generated tables. Please add this feature to the repo.

How to do it: Search for workflows in the search to quickly get to workflows console page. In workflow you will see the daily incremental dataform job. If you delete workflow, it will not continue daily data collection from the BigQuery export tables. To pause the vertex pipelines you can go to http://console.cloud.google.com/vertex-ai/pipelines/schedules and and pause all the scheduled jobs.

How to check: Go to http://console.cloud.google.com/bigquery/dataform/locations/us-central1/repositories/marketing-analytics/details/workflows and check when the execution was last run. If it turned off, you will not get new execution in this list. Check all the vertex-ai pipeline schedules are paused as well

chmstimoteo commented 7 months ago

@mansiparikh why would you stop the processing of the data and sending the predictions to your Google Ads property?

mansiparikh commented 4 months ago

@mansiparikh why would you stop the processing of the data and sending the predictions to your Google Ads property?

Hello, Carlos! Thanks for the reply. It's for when clients need to pause between the implementation and the next project since the most use of jumpstart can come when there is follow-on work of some kind but the data cannot be collected in the meantime (storage bill, etc.).

chmstimoteo commented 3 months ago

This issue is fixed in the documentation. In the config.yaml.tftpl the pipelines are PAUSED by default. Making one paying attention to ENABLING them before use.