Closed mrjsj closed 7 months ago
closes #15
methodology based off Delta Spark docs: https://docs.delta.io/latest/delta-update.html#slowly-changing-data-scd-type-2-operation-into-delta-tables
had to upgrade deltalake package to suppoert .merge() and also to support filters parameter in to_pyarrow_table
closes #15
methodology based off Delta Spark docs: https://docs.delta.io/latest/delta-update.html#slowly-changing-data-scd-type-2-operation-into-delta-tables
had to upgrade deltalake package to suppoert .merge() and also to support filters parameter in to_pyarrow_table