search

delta-io / delta-rs

A native Rust library for Delta Lake, with bindings into Python
https://delta-io.github.io/delta-rs/
Apache License 2.0
2.22k stars 394 forks source link

Datafusion scan fails on dictionary column #1194

Closed wjones127 closed 1 month ago

wjones127 commented 1 year ago

Environment

Delta-rs version:

Binding:

Environment:

Bug

What happened:

Reported in https://github.com/delta-io/delta-rs/pull/1187#issue-1601421482

scanning delta-0.8.0-partitioned results in:

External(Execution("Failed to map column projection for field year. Incompatible data types Dictionary(UInt16, Utf8) and Utf8"))

What you expected to happen:

How to reproduce it:

More details:

rtyler commented 1 year ago

@wjones127 does this still fail after the recent upgrades to datafusion and arrow?

ion-elgreco commented 1 month ago

Closing it as stale, and I believe this is resolved