Closed bgarf closed 2 years ago
Thanks for your pull request. Is this your first contribution to a Snowplow open source project? Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA).
:memo: Please visit https://docs.snowplowanalytics.com/docs/contributing/contributor-license-agreement/ to learn more and sign.
Once you've signed, please reply here (e.g. I signed it!) and we'll verify. Thanks.
Signed the CLA 👍
Bots gone walkies. I can confirm the CLA has been signed.
Description & motivation
Add the capability to exclude unwanted versions from the
combine_column_version
macro.We've encountered a need for this as we have introduced breaking changes to entity versions that cause BigQuery compilation errors when coalescing. For example, a change in field type across versions. This change allows for the avoidance of this by dropping known problematic versions out of the coalesce.
This change makes the assumption that the column's version is always provided as the last 5 characters at the end of the column name (
column_X_X_X
).Example of use
To exclude version
1_0_0
from the coalescing:Checklist