search

airbytehq / airbyte-dbt-models

Models to be used to leverage Airbyte output connector data.
MIT License
5 stars 15 forks source link

feat(source-facebook-marketing): added fivetran dbt converter #55

Closed FloDevelops closed 2 months ago

FloDevelops commented 2 months ago

resolves #10

✅ I moved the logic as much upstream as I could as seen in other issues, reducing the complexity.

⚠️ I likely have rare Postgresql syntax to wrap around a new macro to extract sublevel json text for BQ and SF.

Just want to make sure I am in the right direction and almost ready to merge.

marcosmarxm commented 2 months ago

Thanks @FloDevelops I'm gonna review tomorrow and give feedback about the contribution. It looks Facebook uses the union macro to query staging tables.

FloDevelops commented 2 months ago

@marcosmarxm correct! Fivetran's staging/source package unions multiple sources into temporary models. These temporary models are then used to create the staging models.

To minimize the conversion while keeping the most functionalities, I rebuilt the temporary models with Airbyte sources. This way, I am still using Fivetran's staging and analytical models.

FloDevelops commented 2 months ago

@marcosmarxm just added the /vars file for the CI