search

marsupialtail / quokka

Making data lake work for time series
https://marsupialtail.github.io/quokka/
Apache License 2.0
1.14k stars 60 forks source link

Write Apache Arrow Flight server in C++ #15

Closed marsupialtail closed 1 year ago

marsupialtail commented 2 years ago

This needs to happen at some point.

Issues are static linking apache arrow. ideally we just copy a binary. I guess we could also copy a binary and the arrow shared object. The problem now is we have to find the right arrow shared object for the target cloud environment. This probably fine. If you install pyarrow it comes with the shared objects.

Getting this to work is critical for performance.

marsupialtail commented 1 year ago

It's not critical for performance.