microsoft / fabricnotes

Simple drawings illustrating the main concepts of Microsoft Fabric to empower anyone to build stuff on Fabric.
https://microsoft.github.io/fabricnotes
Creative Commons Attribution 4.0 International
88 stars 18 forks source link

SCD Types - Manage historical change #47

Open brunomalhano opened 1 month ago

brunomalhano commented 1 month ago

What concept do you need more clarity on?

Slowly Changing Dimensions (SCD) are techniques used in data warehousing to manage changes in dimension data over time while maintaining historical accuracy. There are three main types:

  1. SCD Type 1 (Simple Overwrite): Updates the data by replacing the old value without retaining any history.
  2. SCD Type 2 (Full History): Maintains a complete history by adding new rows for each change, with start and end dates.
  3. SCD Type 3 (Limited History): Stores only the most recent change, keeping the previous value in a separate column.

These methods help ensure that historical data is managed according to business requirements for analysis and reporting.

Any reference explaining that concept https://learn.microsoft.com/en-us/fabric/data-warehouse/dimensional-modeling-dimension-tables#manage-historical-change https://learn.microsoft.com/en-us/fabric/data-factory/slowly-changing-dimension-type-one https://learn.microsoft.com/en-us/fabric/data-factory/slowly-changing-dimension-type-two

Have you checked the list of issues to see if there is a similar suggestion?