risingwavelabs / dbt-risingwave

Apache License 2.0
21 stars 6 forks source link

Discussion: Support incremental materialization #40

Closed chenzl25 closed 8 months ago

chenzl25 commented 8 months ago

Currently, dbt-risingwave doesn't support incremental materialization and recommends users use materialized_view instead, because RisingWave could maintain materialized views incrementally in real-time. However, dbt itself is well known for the incremental materialization, many users know how incremental works and how to use it. When they fully understand the trade-off between real-time stream processing and incremental batch processing, you want to use incremental materialization to optimize their workload. E.g. they can run dbt for incremental models every midnight.