search

duckdb / duckdb_delta

DuckDB extension for Delta Lake
MIT License
132 stars 14 forks source link

TypeMismatchException when delta has a new field in struct. #59

Open mervynzhang opened 3 months ago

mervynzhang commented 3 months ago

Hi there,

Got the following error when reading a delta table,

TypeMismatchException: Mismatch Type Error: Type 
STRUCT(a VARCHAR, b VARCHAR, c VARCHAR) does not match with 
STRUCT(a VARCHAR, b VARCHAR, c VARCHAR, 
       d VARCHAR). 
Cannot cast STRUCTs of different size

I compare the table schema, it indeed has a new filed in this struct.

It looks very similar to https://github.com/duckdb/duckdb/issues/7734, it's fixed for python, not sure it should be fixed in duckdb or delta side?

Thanks

samansmink commented 3 months ago

Thanks for reporting @mervynzhang this is a known issue at the moment and is something we are working on!