snowplow / dbt-snowplow-utils

Snowplow utility functions to be used in conjunction with the snowplow-web dbt package.
Other
13 stars 6 forks source link

Release/snowplow utils/0.14.3 #134

Closed rlh1994 closed 1 year ago

rlh1994 commented 1 year ago

Description & motivation

This release does 2 things: 1) It adds the ability to add the package name that is calling the run limits to the message, which was a requested feature and will need porting into our other packages but this enables it. 2) It fixes a weird databricks bug that can happen when you try and array sort hundreds of nulls that leads to a java based error. I can't reliably reproduce it in the int tests without adding thousands of events so you'll have to take my word that it seems to consistently fix the issue by removing null-valued items from the sort first (these were removed by the array_join function later anyway so the result is the same). This should be more efficient and not cause the same issue.

I've done it in one big PR because it's was two tiny changes. None of these should be breaking so we can do a patch release which means that no other packages will need bumping. @emielver you should be able to easily rebase but I don't think it matters much.

Checklist

Release Only Checklist