added kill_duplicates - Githubissues

mrpowers-io / levi

Delta Lake helper methods. No Spark dependency.

MIT License

21 stars 8 forks source link

Closed mrjsj closed 6 months ago

mrjsj commented 7 months ago

Closes #16

this only contains the kill duplicates function which works, but only with deltalake ~0.15.3~ 0.12.0 and above which this PR doesn't include.

also the test_updated_partitions_without_time_filter seems to fail with newer deltalake version due to sort order of the output