search

AbsaOSS / spline

Data Lineage Tracking And Visualization Solution
https://absaoss.github.io/spline/
Apache License 2.0
587 stars 155 forks source link

Better UDF visualization #29

Open wajda opened 6 years ago

wajda commented 6 years ago

Thanks to Alper Topcuoglu https://anchormen.nl/blog/big-data-services/spline/ (see Case 2 (Handling UDF + SQL))

Relates to #28

mn-mikke commented 6 years ago

Is it possible? There is not much we could highlight about UDFs except their names... Even Spark Catalyst has to treat them as a black box since information extraction from a piece of byte code is really tricky problem.

wajda commented 6 years ago

No, we're not talking about introspecting UDFs. The point of this ticket is to improve the way how calls to UDFs are represented on the UI. We now have those ugly toString() representations of expressions. Surely we could make them more readable.