apache / arrow-flight-sql-postgresql

Apache Arrow Flight SQL adapter for PostgreSQL
https://arrow.apache.org/flight-sql-postgresql/
Apache License 2.0
65 stars 9 forks source link

Improve `SELECT text` performance #177

Open kou opened 10 months ago

kou commented 10 months ago

It's slower than the PostgreSQL protocol.

The followings may be related but we need to look into it:

davidhcoe commented 6 months ago

I was wondering if there is an update on this for the performance comparison. And whether any research had gone in to whether this might work with https://github.com/timescale/timescaledb.

kou commented 6 months ago

I have some more ideas (e.g. internal naive ring buffer implementation may be bottleneck) but I haven't worked on this so much yet.

I haven't tried this with TimescaleDB but it will work because this doesn't care about executed SELECT.