latitude-dev / latitude

Developer-first embedded analytics
https://latitude.so
GNU Lesser General Public License v3.0
669 stars 26 forks source link

Materialized queries connector #382

Closed andresgutgon closed 2 weeks ago

andresgutgon commented 3 weeks ago

What?

We want to allow users cache queries from their sources on disk to improve performance. The queries will be stored in parquet format and read with DuckDB. For that reason, this new connector inherits from our existing DuckDB connector. This PR starts the work in this connector to make it usable in development and writing queries to disk.

Issue ticket number and link

https://github.com/latitude-dev/latitude/issues/369

Dependency

https://github.com/latitude-dev/latitude/pull/384 https://github.com/latitude-dev/latitude/pull/397

Checklist before requesting a review

changeset-bot[bot] commented 3 weeks ago

⚠️ No Changeset found

Latest commit: aa214ce30e6b463f7009b70d59eddfd518d3bed4

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

andresgutgon commented 2 weeks ago

Re-open here https://github.com/latitude-dev/latitude/pull/417