search

azavea / hiveless

Scala API for Hive UDFs with the GIS extension
Apache License 2.0
7 stars 1 forks source link

Some sql functions not included #2

Open dersteppenwolf opened 2 years ago

dersteppenwolf commented 2 years ago

There are some functions from geomesa that are not included in hiveles. For example: st-transform https://www.geomesa.org/documentation/stable/user/spark/sparksql_functions.html#st-transform

pomadchin commented 2 years ago

Hey @dersteppenwolf, could you help with making a complete list of missing functions?

pomadchin commented 2 years ago

Oh now I remember, so the following functions are not implemented:

These functions belong to the geomesa-spark-sql package which also depends on geotools (and geotools is not published to maven central).

To simplify user experience and ease of use as a package dependency (i.e. in DataBricks) I decided not to add them for now. (could be a separate package)

dersteppenwolf commented 2 years ago

To simplify user experience and ease of use as a package dependency (i.e. in DataBricks) I decided not to add them for now. (could be a separate package)

It would be really useful.

BTW, great work. I've made some tests using "Databricks Runtime Version - 9.1 LTS Photon (includes Apache Spark 3.1.2, Scala 2.12)" and works really well.

pomadchin commented 2 years ago

@dersteppenwolf thanks for the feedback, I'm happy that it is useful for you!

Adding these functions is definitely in the scope (+ extra thanks for rising this issue).