CoxAutomotiveDataSolutions / waimak

Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
Apache License 2.0
75 stars 16 forks source link

Fix issue with sql server temporal query returning too many rows #103

Closed jamesfielder closed 4 years ago

jamesfielder commented 4 years ago

Description

Fix the sql server temporal query to select only data that has changed since last run correctly.

Fixes # (issue)

Type of change

Please delete options that are not relevant.

How Has This Been Tested?

Tested locally using mssql and on environments in Cox Auto.