[HUDI-8468] use payload to do merging inside the expression payload

apache / hudi

Upserts, Deletes And Incremental Processing on Big Data.

https://hudi.apache.org/

Apache License 2.0

5.45k stars 2.43k forks source link

[HUDI-8468] use payload to do merging inside the expression payload #12242

Open Davis-Zhang-Onehouse opened 1 week ago

Davis-Zhang-Onehouse commented 1 week ago

Change Logs

Use payload to do merging inside of expression payload. If your tables payload was overwrite with latest, and you did MIT, it would use ordering field if defined. Now we will use the actual payload.

Impact

MIT is more correct

Risk level (write none, low medium or high below)

low

Documentation Update

N/A

Contributor's checklist

[ ] Read through contributor's guide
[ ] Change Logs and Impact were stated clearly
[ ] Adequate tests were added if applicable
[ ] CI passed

hudi-bot commented 1 week ago

CI report:

774f2e455d1cd27cd79289487e873ed3846ace51 Azure: SUCCESS

Bot commands

@hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the last Azure build