search

delta-io / delta-rs

A native Rust library for Delta Lake, with bindings into Python
https://delta-io.github.io/delta-rs/
Apache License 2.0
2.14k stars 380 forks source link

delta reader version 2 #1412

Open dseynaev opened 1 year ago

dseynaev commented 1 year ago

Hi,

When attempting to test (through polars), I was immediately met with:

deltalake.table.DeltaTableProtocolError: The table's minimum reader version is 2but deltalake only supports up to version 1.

since this is not listed in the 2023 H1 roadmap I was wondering how far of this is (and/or what is blocking).

wjones127 commented 1 year ago

This will likely be on the roadmap for end of this year. We've mostly held off on it because it will require essentially a full rewrite of our Python scanner. But I'll be ready to start on that in a month or so.

PurnaChandraPanda commented 8 months ago

Hello @wjones127 , Do we have any update if there is plan to roll this out?

jtanx commented 3 months ago

Any update on this? Might be reading this wrong but seems like version 3 is marked as supported but not 2?

roeap commented 3 months ago

version 3 introduces table features, which we are supporting one-by-one. previously to be compliant with a version all features for that version needed tobe supported.