dbt-labs / docs.getdbt.com

The code behind docs.getdbt.com
https://docs.getdbt.com/
Apache License 2.0
128 stars 955 forks source link

[Core] - Recommend using new snapshot configurations for net-new snapshots only #6374

Open dbeatty10 opened 4 weeks ago

dbeatty10 commented 4 weeks ago

Contributions

Link to the page on docs.getdbt.com requiring updates

https://docs.getdbt.com/reference/snapshot-configs

What part(s) of the page would you like to see updated?

Snapshots and incremental models are meant to be long-lived tables. In particular, snapshots capture history of data that might not be available anymore (or is expensive / difficult to replay). So they are more sensitive to either user bugs in modeling logic or bugs in the underlying dbt software -- in the worst case, there can be unrecoverable data loss.

So to reduce the blast radius of potential bugs in the dbt implementation, in we are recommending using the new v1.9 snapshot configurations with net new snapshots rather than pre-existing ones. This is in the same spirit as https://github.com/dbt-labs/dbt-core/issues/10923 (which might not be possible or reasonable to implement).

Additional information

No response

graciegoheen commented 4 weeks ago

For new-new snapshots or migrate your old snapshot before running

hope-wat commented 3 weeks ago

or migrate your old snapshot before running

Would we essentially recommend running alter statements manually?

dbeatty10 commented 3 weeks ago

Would we essentially recommend running alter statements manually?

Yes. To perform the applicable migration, we'd be recommending first making a backup copy (or clone) and then applying the applicable alter statements either manually or with a script.