Initialize partition stats based on latest file slices only instead of all files in a partition.
Impact
Initalization of partition stats should take much less time.
Risk level (write none, low medium or high below)
low
Documentation Update
Describe any necessary documentation update if there is any new feature, config, or user-facing change. If not, put "none".
The config description must be updated if new configs are added or the default value of the configs are changed
Any new feature or user-facing change requires updating the Hudi website. Please create a Jira ticket, attach the
ticket number here and follow the instruction to make
changes to the website.
hudi-bot
commented
1 week ago
Change Logs
Initialize partition stats based on latest file slices only instead of all files in a partition.
Impact
Initalization of partition stats should take much less time.
Risk level (write none, low medium or high below)
low
Documentation Update
Describe any necessary documentation update if there is any new feature, config, or user-facing change. If not, put "none".
Contributor's checklist