search

airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
15.48k stars 3.99k forks source link

Source Adwords: allow segmenting reports #3521

Open sherifnada opened 3 years ago

sherifnada commented 3 years ago

Tell us about the problem you're trying to solve

Various Google Adwords reports allow segmenting how the data is aggregated. For example, the ad_performance_report allows segmenting by device, age, gender, geography, etc..

Today the adwords API does not segment reports by default and does not allow the user to configure segmentation.

Describe the solution you’d like

There's a few options:

  1. Create extra streams which are essentially hardcoded segmentations of reports e.g: ad_performance_age_report, ad_performance_device_report which are essentially age/device segmented versions of that report. The upside is this option is very simple and requires almost no configuration. The downside is that this significantly limits the degrees of freedom you can use in segmentation, since there are literally tens of thousands of combinations of possible segmentation options.
  2. Allow each stream to expose essentially a version of a spec which defines the configurations that stream accepts. This is a much much heavier lift and requires changes to the protocol.

I prefer option 1 for the time being.

┆Issue is synchronized with this Asana task by Unito

zestyping commented 3 years ago

As one data point, the top-priority segmentations for us at TFC are device and geography, followed by age and gender. Thanks for looking into this!