Open danthegoodman1 opened 1 year ago
Support coordination for concurrent merges to prevent duplicate data.
Maybe we make a class to implement that will handle the locking and such, with examples?
The class would need:
Example options:
Merging locks should be by table
Should we just have examples of how to do this?
with the new s3 conditional writes, this can even be done in pure S3!
Support coordination for concurrent merges to prevent duplicate data.
Maybe we make a class to implement that will handle the locking and such, with examples?
The class would need:
Example options:
Merging locks should be by table