Closed asingamaneni closed 7 months ago
All modified and coverable lines are covered by tests :white_check_mark:
Comparison is base (
5e6c601
) 100.00% compared to head (f4e5876
) 100.00%.
:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.
LGTM
I see we are retrying the write irrespective of exception caused. Should we not retry only when it failed for concurrent writes ?
Also as per delta Lake doc multiple Inserts
should not conflict. Can you please share the exception details ( the stack trace ) ?
Description
Making code changes so as to support retries for writing into table if it fails. Update table properties only if the property is not already written.
Related Issue
60
Motivation and Context
When there are multiple processes writing at the same time into the stats table, having issues with concurrent writes. Adding retries and also write table properties only when not written.
How Has This Been Tested?
The code has been unit tested
Screenshots (if appropriate):
Types of changes
Checklist: