splitgraph / seafowl

Analytical database for data-driven Web applications 🪶
https://seafowl.io
Apache License 2.0
386 stars 9 forks source link

Caching object store improvements: chunk coalescing #514

Closed gruuya closed 2 months ago

gruuya commented 2 months ago

This PR introduces a new caching mechanism for fetching byte ranges:

The timeout is important to break some hanging issues I've noticed (notably, TPC-H SF10 q18 and q21).

gruuya commented 2 months ago

Closing for now in favor of https://github.com/splitgraph/seafowl/pull/515.

Can be re-visited later if needed.