apache / hudi

Upserts, Deletes And Incremental Processing on Big Data.
https://hudi.apache.org/
Apache License 2.0
5.45k stars 2.43k forks source link

[HUDI-8557] Enable metadata on the Spark reader by default #12240

Open codope opened 1 week ago

codope commented 1 week ago

Change Logs

Enable metadata on the Spark reader by default. Data skipping (hoodie.enable.data.skipping) is already enabled by default. Other things such as BQ sync will still keep the same behavior i.e. DEFAULT_METADATA_ENABLE_FOR_READERS = false.

Impact

Enable metadata on the Spark reader by default

Risk level (write none, low medium or high below)

medium

Documentation Update

Describe any necessary documentation update if there is any new feature, config, or user-facing change. If not, put "none".

Contributor's checklist

hudi-bot commented 1 week ago

CI report:

Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build