search

eto-ai / rikai

Parquet-based ML data format optimized for working with unstructured data
https://rikai.readthedocs.io/en/latest/
Apache License 2.0
136 stars 19 forks source link

`to_image` or `image` automatically registered Scala UDF #645

Closed da-liii closed 2 years ago

da-liii commented 2 years ago

I will setup a Rikai production airflow dag, and I found it frustrating that we have to register a python UDF and then use it.

I want to setup the airflow dag using only rikai sql, I do not want to make a python whl (just to register the python UDF) for this production dag.

I think at least to_image should be re-impl in Scala, or we just use another udf name, like image.