NVIDIA / spark-rapids-tools

User tools for Spark RAPIDS
Apache License 2.0
50 stars 37 forks source link

[audit 4.0] [SPARK-48479] Investigate new UDF support - make sure tools can recognize #1162

Open tgravescs opened 3 months ago

tgravescs commented 3 months ago

Is your feature request related to a problem? Please describe. related to https://github.com/NVIDIA/spark-rapids/issues/11098

Spark added a new way to create UDFs, commit: https://github.com/apache/spark/commit/0d9f8a107f5 issue: https://issues.apache.org/jira/browse/SPARK-48479

we may want to look to make sure the tools can recognize this the same as defining udfs the other methods.