Yield individual chunks to datafusion instead of canonoicalizing chunked array

spiraldb / vortex

An extensible, state-of-the-art columnar file format

https://vortex.dev

Apache License 2.0

989 stars 27 forks source link

Open robert3005 opened 1 day ago

robert3005 commented 1 day ago

If returned array is a chunked array we should yield individual chunks instead of canonicalizing chunks to record batch