apache / iceberg

Apache Iceberg
https://iceberg.apache.org/
Apache License 2.0
6.49k stars 2.24k forks source link

write.wap.enabled / spark.wap.branch behavior isn't really documented #11528

Open wimlewis-amazon opened 1 week ago

wimlewis-amazon commented 1 week ago

Feature Request / Improvement

It's unclear from reading the doc what the effect of setting write.wap.enabled actually is. I can make some assumptions based on the write-audit-publish example, but those assumptions are almost certainly incomplete (for example, there are edge cases and failure conditions that I would need to understand before applying this in production, but the example only shows the "happy path".). As a user of the Iceberg libraries, I would like the documentation to be more explicit about what changes if I set either of these configuration options.

Query engine

Spark

Willingness to contribute