search

mrpowers-io / levi

Delta Lake helper methods. No Spark dependency.
MIT License
21 stars 8 forks source link

Implement function to get updated partitions #24

Closed huynguyent closed 7 months ago

huynguyent commented 7 months ago

Address issue https://github.com/MrPowers/levi/issues/23

The logic for exclude_optimize_operations mentioned in the issue is more complicated than I expected. I'll implement it in another PR

I also had to regenerate the lock file because of this error when running poetry install

Installing dependencies from lock file
Warning: poetry.lock is not consistent with pyproject.toml. You may be getting improper dependencies. Run `poetry lock [--no-update]` to fix it.

Because levi depends on deltalake (^0.9) which doesn't match any versions, version solving failed.