search

apache / iceberg-python

Apache PyIceberg
https://py.iceberg.apache.org/
Apache License 2.0
472 stars 174 forks source link

Add metadata tables for `data_files` and `delete_files` #1066

Closed soumya-ghosh closed 2 months ago

soumya-ghosh commented 3 months ago

Implements metadata tables for data_files and delete_files - https://github.com/apache/iceberg-python/issues/1053

Have reused the logic of files to derive data_files and delete_files. Also reused the test cases for files (test_inspect_files) as schema is same as files.

soumya-ghosh commented 2 months ago

@kevinjqliu could you execute the workflow for this? I've merged this PR into refactored init.py. Also wanted to check if integration tests are failing here.

soumya-ghosh commented 2 months ago

@sungwy @Fokko could you review this?

kevinjqliu commented 2 months ago

thanks again @soumya-ghosh. I'll wait for another approval before merging.

sungwy commented 2 months ago

Thanks for making this contribution @soumya-ghosh ! And thank you @kevinjqliu and @ndrluis for the detailed reviews!