search

diethardsteiner / bissolTableDataEditor

MIT License
3 stars 2 forks source link

Enhancement - support SCD tables #24

Open johla opened 9 years ago

johla commented 9 years ago

Since the BissoltableDataEditor is using PDI for inserts/updates it should be possible to switch/alternate to a Dimension Lookup Update step, and thereby supporting SCD as well.

Would be a nice enhancement?

diethardsteiner commented 9 years ago

Sounds like a good idea, thanks for submitting.

diethardsteiner commented 9 years ago

@johla: Can you please list the exact requirements? What exactly do you want to see in the editor? Only the latest version of records? The slight problem I see in this case is that some fields might be populated via the ETL in the SCD approach, but some other ones might just be fields that do not require any versioning (kind of mixed SCD Type 2 and Type 1 approach). Simple Example: Let's say my dimensional table stores details about cars. Most fields are maintained using the SCD Type 2 approach, however, there is an additional field called car group which is maintained by the end user and not versioned at all (and the user will also populate the field with values for older versions - not just the most recent ones - in case the value hasn't been provided yet).