apache / iceberg-python

Apache PyIceberg
https://py.iceberg.apache.org/
Apache License 2.0
329 stars 119 forks source link

make to_duckdb accept multiple tables #408

Open djouallah opened 5 months ago

djouallah commented 5 months ago

Feature Request / Improvement

currently it seems con =catalog.load_table('aemo.scada').scan().to_duckdb(table_name="scada") accept only 1 table, it will be nice to have something like con =catalog.load_namespace('aemo').scan().to_duckdb() which will expose the whole database to duckdb in one go

Fokko commented 5 months ago

Thanks for reporting this. I like it! We need to have support for lazy datasets before this becomes feasible.

djouallah commented 2 months ago

is there a way to load two tables, it seems you can only Query 1 table at the time ?