search

databrickslabs / remorph

Cross-compiler and Data Reconciler into Databricks Lakehouse
Other
21 stars 13 forks source link

Support translation of TSQL INGORE NULLS clause in windowing functions #511

Closed jimidle closed 1 month ago

jimidle commented 1 month ago

Certain TSQL windowing functions, requiring an OVER clause, allow the specification of IGNORE NULLS or RESPECT NULLS, which influences their behavior. For instance:

SELECT LEAD(column_name) IGNORE NULLS OVER (ORDER BY other_column)

The equivalent functions in Databricks SQL take an optional trailing boolean parameter, which indicates whether the function should ignore trailing nulls.

Here we append the boolean option to the Databricks windowing functions, when the IGNORE NULLS clause is specified, RESPECT NULLS being the default case.

github-actions[bot] commented 1 month ago

Coverage tests results

394 tests  ±0   353 :white_check_mark: ±0   4s :stopwatch: ±0s   2 suites ±0     2 :zzz: ±0    2 files   ±0    39 :x: ±0 

For more details on these failures, see this check.

Results for commit 03bd0663. ± Comparison against base commit 39c53822.