[audit 4.0] [SPARK-48479]Support creating scalar and table SQL UDFs in parser

NVIDIA / spark-rapids

Spark RAPIDS plugin - accelerate Apache Spark with GPUs

https://nvidia.github.io/spark-rapids

Apache License 2.0

788 stars 228 forks source link

[audit 4.0] [SPARK-48479]Support creating scalar and table SQL UDFs in parser #11098

Open tgravescs opened 2 months ago

tgravescs commented 2 months ago

Is your feature request related to a problem? Please describe. Spark added a new way to create UDFs, commit: https://github.com/apache/spark/commit/0d9f8a107f5 issue: https://issues.apache.org/jira/browse/SPARK-48479

I don't think this will affect us directly but we may want to add some testing with the rapids udf stuff and we may want to look to make sure the tools can recognize this the same as defining udfs the other methods.

mattahrens commented 2 months ago

@tgravescs to file corresponding issue for spark-rapids-tools to handle UDF naming with Spark 4.0.