search

apache / iceberg-rust

Apache Iceberg
https://rust.iceberg.apache.org/
Apache License 2.0
474 stars 97 forks source link

Support to append file on table #345

Open ZENOTME opened 2 months ago

ZENOTME commented 2 months ago

After we finish https://github.com/apache/iceberg-rust/pull/275, we can support to write data and generate theDataFile. To complete #329, the next job is to support append data file and commit on transaction.

We can follow the design according to pyiceberg:

  1. implement _MergingSnapshotProducer and use it to generate the UpdatesAndRequirements.
  2. commit the UpdatesAndRequirements using catalog.

After this, we also can add e2e test for write. This issue also solve #225.

ZENOTME commented 2 months ago

I can send a PR for this later.