markhoerth / dremio_client

Apache License 2.0
31 stars 26 forks source link

return pyarrow.Table instead of return the pandas-compatible NumPy ar… #319

Open TibbersDriveMustang opened 2 years ago

TibbersDriveMustang commented 2 years ago

…ray via to_pandas()

the to_pandas() is pretty expensive, if the returned data size is huge, e.g 8GB, it might cause core crush. return the pyarrow.Table gives end user more fliexibility