[HUDI-8434] Support Flink Async Archive

fhan688 commented 1 week ago

Change Logs

archive operation is now executed in Flink JM in sync mode, which blocks starting a new Instant in heavy work load. thus, write performance is affected. this PR enables async archive in Flink operator.

Impact

hudi-flink-datasource

Risk level (write none, low medium or high below)

none

Documentation Update

none

Contributor's checklist

[ ] Read through contributor's guide
[ ] Change Logs and Impact were stated clearly
[ ] Adequate tests were added if applicable
[ ] CI passed

hudi-bot commented 1 week ago

CI report:

f6bb2b207ae582cb228b02459630c4039f35f524 Azure: FAILURE

Bot commands

@hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build

danny0405 commented 1 week ago

Did you check this fix: https://github.com/apache/hudi/pull/9854/files

fhan688 commented 1 week ago

Did you check this fix: https://github.com/apache/hudi/pull/9854/files

Thanks for reminding. I'll close this.

apache / hudi