search

apache / iceberg-python

Apache PyIceberg
https://py.iceberg.apache.org/
Apache License 2.0
469 stars 170 forks source link

Document Custom FileIO #1233

Open kevinjqliu opened 4 weeks ago

kevinjqliu commented 4 weeks ago

Feature Request / Improvement

Add documentation for custom FileIO, similar to custom catalog

Bring your own FileIO with PY_IO_IMPL https://github.com/apache/iceberg-python/blob/7cf0c225c3cdb32ac5e390de06b7b0e4fe7de92e/pyiceberg/io/__init__.py#L325-L342

sikehish commented 4 weeks ago

Feature Request / Improvement

Add documentation for custom FileIO, similar to custom catalog

Bring your own FileIO with PY_IO_IMPL

https://github.com/apache/iceberg-python/blob/7cf0c225c3cdb32ac5e390de06b7b0e4fe7de92e/pyiceberg/io/__init__.py#L325-L342

I'd like to take this up! Would this be a seperate section under catalogs? And I believe the heading would be "Bring your own FileIO with PY_IO_IMPL" ?

kevinjqliu commented 4 weeks ago

Assigned to you. I think we can add it under the FileIO section as something like "Custom FileIO Implementations"

sikehish commented 4 weeks ago

Assigned to you. I think we can add it under the FileIO section as something like "Custom FileIO Implementations"

Hi @kevinjqliu. I've added custom fileio implementation section in docs. I'm not very sure if what I've added is what you are looking for. Do let me know if any changes are to be made :) Here's the PR: #1238