heavyai / pymapd

Python client for OmniSci GPU-accelerated SQL engine and analytics platform
https://pymapd.readthedocs.io/en/latest/
Apache License 2.0
111 stars 50 forks source link

Unable to load geo and array type columns using load_table arrow method #366

Open anirudh-here-com opened 2 years ago

anirudh-here-com commented 2 years ago

While trying to import a parquet file containing geo and array data using below code

import pymapd
import pyarrow.parquet as pq
from pyarrow import fs

con = pymapd.connect(user="xxx", password="xxx", host="xxx", port=xxx, dbname="xxx")
//load arrow_table from s3
con.load_table("xxx", arrow_table, method='arrow', preserve_index=False)
con.close() 

I get the error "Arrow array appends not yet supported". The geo and array columns are of type string in parquet and in omnisci schema declared as linestring and string[] respectively