latitude-dev / latitude

Developer-first embedded analytics
https://latitude.so
GNU Lesser General Public License v3.0
716 stars 30 forks source link

Materialize storage driver package #421

Closed andresgutgon closed 1 month ago

andresgutgon commented 1 month ago

Describe your changes

When reading with DuckDB the parquet files from materialized queries we need a way of knowing where those queries are stored. We want to allow different ways of storing these parquet files. In this commit we start implementing the driver and the disk implementation that will be used almost always in development

Issue ticket number and link

https://github.com/latitude-dev/latitude/issues/369

Checklist before requesting a review

changeset-bot[bot] commented 1 month ago

🦋 Changeset detected

Latest commit: f84740300eb117d78ec9dcf3961b95c9e4611719

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 16 packages | Name | Type | | ------------------------------------- | ----- | | @latitude-data/source-manager | Minor | | @latitude-data/server | Patch | | @latitude-data/cli | Patch | | @latitude-data/athena-connector | Patch | | @latitude-data/bigquery-connector | Patch | | @latitude-data/clickhouse-connector | Patch | | @latitude-data/databricks-connector | Patch | | @latitude-data/duckdb-connector | Patch | | @latitude-data/materialized-connector | Patch | | @latitude-data/mssql-connector | Patch | | @latitude-data/mysql-connector | Patch | | @latitude-data/postgresql-connector | Patch | | @latitude-data/snowflake-connector | Patch | | @latitude-data/sqlite-connector | Patch | | @latitude-data/test-connector | Patch | | @latitude-data/trino-connector | Patch |

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR