TobikoData / sqlmesh

Efficient data transformation and modeling framework that is backwards compatible with dbt.
https://sqlmesh.com
Apache License 2.0
1.84k stars 161 forks source link

Support Incremental Unmanaged in Native #3423

Open eakmanrq opened 16 hours ago

eakmanrq commented 16 hours ago

This would allow users to do append only inserts. We want to make sure in documentation that we recommend users explore other incremental models before using unmanaged.

sungchun12 commented 15 hours ago

What are clear examples where you recommend this?

dmat commented 14 hours ago

This is a wonderful feature and meets my use case. I'm building a Data Vault based Datawarehouse, and one of the fundamental principles is to insert only operations for auditability and scalability. Can't wait for this feature. One recommendation is the ability to do controlled restatement and new snapshots for breaking changes.