Describe the task
ETL Tool needs to have a possibility to execute Delta loads, what means it will work only on new data not yet loaded in the target connection (instead of full loads, that gathers all data from source to load in target)
Acceptance Criteria
[ ] ETL_SCHEDULE table to store Delta timestamps (last timestamp processed and current timestamp)
[ ] LOAD queries should have placeholders to include the Delta timestamps for DELTA loads.
[ ] Only changed data should be inserted/updated in the Target connection.
Additional context
It is referring to ETL Tool core code. It affects all running ETL Tool execution instances.
Describe the task ETL Tool needs to have a possibility to execute Delta loads, what means it will work only on new data not yet loaded in the target connection (instead of full loads, that gathers all data from source to load in target)
Acceptance Criteria
Additional context It is referring to ETL Tool core code. It affects all running ETL Tool execution instances.