datatype geometry is not supported when 'create table xxx (geom geometry)' - Githubissues

apache / sedona

A cluster computing framework for processing large-scale geospatial data

https://sedona.apache.org/

Apache License 2.0

1.81k stars 655 forks source link

datatype geometry is not supported when 'create table xxx (geom geometry)' #1414

Open freamdx opened 1 month ago

freamdx commented 1 month ago

Expected behavior

Actual behavior

Steps to reproduce the problem

server: copy sedona-spark-shaded-3.x_2.12-1.5.x.jar to 'spark/jars'
client: connect to spark-thrift-server, eg: beeline -u jdbc:hive2://<...>:<...>
client: create table test (geom geometry);

Settings

Sedona version = 1.5

Apache Spark version = 3.x

Environment = spark-thrift-server

freamdx commented 1 month ago

one way (not best):

freamdx commented 1 month ago

refer: https://github.com/freamdx/spark/commit/cf2b0fe18c938744f2cfb111f6878eec8ad220cf

jiayuasu commented 1 month ago

@freamdx Thanks. This is on our radar. This can be done via adding a custom Sedona SQL parser on top of Spark, without forking Spark code. We will add the support in 1.6.1 release.