dsl in functions package for lambda related functions

sparkutils / quality

A Quality Spark DQ Library

https://sparkutils.github.io/quality/

Apache License 2.0

4 stars 2 forks source link

Closed chris-twiner closed 1 year ago

chris-twiner commented 1 year ago

utilise the createLambda approach from catalyst.functions to manage

chris-twiner commented 1 year ago

only agg_expr, dsl wise all other lambda looking things are best done as evaluations on column in user code.