Velir / dbt-ga4

dbt Package for modeling raw data exported by Google Analytics 4. BigQuery support, only.
MIT License
321 stars 135 forks source link

Example using Snowflake #72

Closed tomredman closed 2 years ago

tomredman commented 2 years ago

Is it possible to use this package with Snowflake as the data warehouse? If so, what would the settings be?

Thanks in advance!

adamribaudo-velir commented 2 years ago

Hi Tom, likely not because we hadn't considered that use case and have implemented some BQ-specific commands such as _TABLE_SUFFIX and unnest.

Just curious, how are you going about replicating your GA4 data to Snowflake?

From: Tom Redman @.> Sent: Friday, October 7, 2022 11:17 AM To: Velir/dbt-ga4 @.> Cc: Subscribed @.***> Subject: [Velir/dbt-ga4] Example using Snowflake (Issue #72)

Is it possible to use this package with Snowflake as the data warehouse? If so, what would the settings be?

Thanks in advance!

- Reply to this email directly, view it on GitHubhttps://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FVelir%2Fdbt-ga4%2Fissues%2F72&data=05%7C01%7Cadam.ribaudo%40velir.com%7C354a3060dae84f8e719a08daa876e9df%7C750f89c4532d43399fd9b605eca241c8%7C1%7C0%7C638007525956462558%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=3qUaTNzsGRNSmxKUqp2J3oy0qSyZ0cq2rjRBPEu2nvQ%3D&reserved=0, or unsubscribehttps://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FARCCAAFTIILU6UUAMEIBTCTWCA5E5ANCNFSM6AAAAAAQ7V7WTI&data=05%7C01%7Cadam.ribaudo%40velir.com%7C354a3060dae84f8e719a08daa876e9df%7C750f89c4532d43399fd9b605eca241c8%7C1%7C0%7C638007525956462558%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=nvjMC1Hy2FoqyadzHjE3RdovqG%2Fjtxe9uoeK3Wii9jI%3D&reserved=0. You are receiving this because you are subscribed to this thread.Message ID: @.**@.>>

tomredman commented 2 years ago

Thanks for the quick reply! We're using a Fivetran connection to take the GA4 data and push it to Snowflake.

zachrenwick commented 2 years ago

The Fivetran connector for GA4 does not load the data in the same schema necessary for this dbt project to transform the data: https://fivetran.com/docs/applications/google-analytics-4#schemainformation

This project is built upon raw, hit/event level data whereas the Fivetran connnector looks to aggregate only specific dimensions and measures you select.

The bigger issue here is getting access to the raw clickstream data :)

adamribaudo-velir commented 2 years ago

Zach is exactly right. Using Fivetran in many ways negates needing to use this package because your raw data has already been transformed into modeled data.

tomredman commented 2 years ago

Indeed! I see it's pulling in a number of reports already. Thank you all!