bacalhau-project / bacalhau

Compute over Data framework for public, transparent, and optionally verifiable computation
https://docs.bacalhau.org
Apache License 2.0
641 stars 85 forks source link

Atomic job store transactions #3993

Closed wdbaruni closed 1 month ago

wdbaruni commented 1 month ago

Today we run job store operations in their isolation transaction, which prevents us from doing atomic transactions that span multiple operations, such as handling a single scheduler plan that can involve updating the job state, updating the state of multiple executions, enqueueing delayed evaluations and adding history events.

We need way to start a single transaction and have all these operations to be committed atomically or rolled-back