airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
16.07k stars 4.11k forks source link

Source Amazon Ads: dynamic date, customizable report type and metrics #13386

Open mendeel opened 2 years ago

mendeel commented 2 years ago

Tell us about the problem you're trying to solve

As of right now, the Amazon Ads connector generates all of the available reports everytime it syncs right out of the box. In this case, if you want to extract a large range and if you have a lot of data, it can take quite a lot of time to complete the sync.

Describe the solution you’d like

I'd like to suggest the following changes in the connector settings:

Describe the alternative you’ve considered or used

For the Dynamic Date, I'll try to use Airbyte's API to dynamically change the connector settings, although it'd be much easier if it had this option out of the box.

Additional context

Hope this request if within the guidelines :D If not, I'll happily edit it. Thanks for the attention :)

marcosmarxm commented 2 years ago

Dynamic start date: for example "Last 15 days", "Last 30 days". As of right now, it only syncs yesterday OR a fixed start date that the user sets.

There is a specific issue to have dynamic window start date

mendeel commented 2 years ago

Dynamic start date: for example "Last 15 days", "Last 30 days". As of right now, it only syncs yesterday OR a fixed start date that the user sets.

There is a specific issue to have dynamic window start date

Oh sorry! I swear I've done my research looking for past issues but seems like I couldn't find this one. Could you link it here, please?

alafanechere commented 2 years ago

There is a specific issue to have dynamic window start date

@marcosmarxm I was not able to find a duplicate issue, could you please share the link if you have it?

natalyjazzviolin commented 2 years ago

@marcosmarxm following up on the previous comment: could you please link to the duplicate issue you mentioned?