search

Quansight / omnisci

Explorations on using MapD and Jupyter together.
4 stars 1 forks source link

[pymapd] load_table array implementation for columnar mode #120

Closed xmnlab closed 3 years ago

xmnlab commented 4 years ago

Objective

Add support to load_table with array columns.

Context

pymapd load_table array can be called using the follow methods:

For more information about OmniSciDB array support, see https://docs.omnisci.com/latest/5_dml.html#array-support

xmnlab commented 4 years ago

it seems that currently it is working with rows method: https://github.com/Quansight/ivan-sandbox/blob/master/pymapd/load-table-array-rows.ipynb

xmnlab commented 4 years ago

Currently, array datatype support for load_table arrow method is blocked by https://github.com/omnisci/omniscidb/blob/master/Import/Importer.cpp#L932

xmnlab commented 4 years ago

PR: https://github.com/omnisci/pymapd/pull/311

xmnlab commented 3 years ago

as load_table using arrow method is blocked by server side (omniscidb) ... it maybe need to be treated separated. not sure yet if we need/can do anything for now.

xmnlab commented 3 years ago

omnisci/pymapd#311 merged. pymapd now has load_table with columnar method support for array data.