Open jochenchrist opened 2 weeks ago
DuckDB now has native Deltalake support: https://duckdb.org/2024/06/10/delta
This can replace the current PyArrow implementation and we can save a few hundres MBs of dependencies.
Repository: https://github.com/duckdb/duckdb_delta
@jochenchrist
If you haven't started working on this yet, I would like to take a crack at it.
DuckDB now has native Deltalake support: https://duckdb.org/2024/06/10/delta
This can replace the current PyArrow implementation and we can save a few hundres MBs of dependencies.
Repository: https://github.com/duckdb/duckdb_delta