search

apache / iceberg

Apache Iceberg
https://iceberg.apache.org/
Apache License 2.0
5.88k stars 2.07k forks source link

Iceberg Materialized Views #10043

Open JanKaul opened 3 months ago

JanKaul commented 3 months ago

Proposed Change

A materialized view is a common concept in Database Management Systems that stores a query definition as a logical table. The query is precomputed and the resulting data is served when the materialized view is queried. The cost of query execution is pushed to the precomputation step and is amortized over the query executions. Materialized views are a tool that can be used to speed up common queries.

The goal of this proposal is to define a common metadata format for materialized views, enabling materialized views to be created, read and updated by different query engines.

References:

  1. Design discussion
  2. Initial issue
  3. Initial concept discussion

Proposal document

https://docs.google.com/document/d/1UnhldHhe3Grz8JBngwXPA6ZZord1xMedY5ukEhZYF-A/edit?usp=sharing

Specifications

wmoustafa commented 3 months ago

Implementation PR for Option 1 in the proposal doc: https://github.com/apache/iceberg/pull/9830.