search

apache / hudi

Upserts, Deletes And Incremental Processing on Big Data.
https://hudi.apache.org/
Apache License 2.0
5.48k stars 2.44k forks source link

[SUPPORT] OCC experimental ? #11839

Open anambiar-epsilon opened 3 months ago

anambiar-epsilon commented 3 months ago

[SUPPORT] in https://hudi.apache.org/docs/concurrency_control its written Please note that this feature is currently experimental and requires external lock providers to acquire locks briefly at critical sections during the write. More on lock providers below. is this general for OCC or is it experimental for internal lock providers ?? i have a requirement to run multiple jobs majorly for deleting older partitions over the continuous stream ingestion, can i use dynamo db as a locking mechanism and enable OCC ?

danny0405 commented 3 months ago

I think the doc is kind of legacy, OCC is a mature feature now.

ad1happy2go commented 3 months ago

@anambiar-epsilon I will get the docs updated for this.

Any issues are you facing here?