Open liurenjie1024 opened 2 weeks ago
I'm happy to start looking into this one if you like?
I'm happy to start looking into this one if you like?
Thanks @sdd !
Hi @liurenjie1024. I have a query regarding flattening. You gave this example in Issue #244:
... For example, when we select (
person.address.street
,person.name
], we have projection mask[1,2]
, and the returned schema isschema { struct person { struct address { string street } string name } }
But what we expect is
schema { string person string name }
Originally posted by @liurenjie1024 in https://github.com/apache/iceberg-rust/issues/244#issuecomment-2021856565
Why do we expect that? I would have thought it would turn out like this:
schema {
string street
string name
}
@sdd Yes, it was a typo, it should be
schema {
string street
string name
}
This is a follow up issue of #244, where we have some limitations of reading into arrow record batch:
We should implement sth like ArrowProjectionVisitor to support these.