spiceai / spiceai

A self-hostable CDN for databases. Spice provides a unified SQL query interface and portable runtime to locally materialize, accelerate, and query datasets across databases, data warehouses, and data lakes.
https://docs.spiceai.org
Apache License 2.0
1.83k stars 72 forks source link

Enhancement: support Clickhouse as an accelerator engine #2287

Open tekumara opened 4 weeks ago

tekumara commented 4 weeks ago

Goal-State/What/Result

Clickhouse as an accelerator engine.

Why/Purpose

We’ve found Clickhouse to be more performant than duckdb for our workload.

By When

A target date for done-done completion of the entire enhancement.

Issue/Spec written and reviewed: Done-Done:

Done-Done

The Algorithm

Spec

Basic specification of the enhancement.

How/MAP

A clear and concise plan of how this should be implemented.

Implementation (issues)

QA

phillipleblanc commented 3 weeks ago

@tekumara - We already support Clickhouse as a connector: https://docs.spiceai.org/components/data-connectors/clickhouse - Do you mean you want to be able to use Clickhouse as an accelerator engine?

tekumara commented 3 weeks ago

Yes as an accelerator engine, to cache data in s3 🙏

lukekim commented 3 weeks ago

@tekumara thanks for the suggestion!

lukekim commented 3 weeks ago

@tekumara also left you a DM on X.