Special oplog implementation for ephemeral workers - Githubissues

golemcloud / golem

Golem is an open source durable computing platform that makes it easy to build and deploy highly reliable distributed systems.

https://learn.golem.cloud/

Apache License 2.0

532 stars 59 forks source link

Special oplog implementation for ephemeral workers #972

Closed vigoo closed 2 months ago

vigoo commented 2 months ago

Resolves #935

Introduces a new oplog implementation for ephemeral workers, with the following properties:

It directly writes to the last oplog archive (targeting the blob store with the default config)
It has a separate "max entries before commit" configuration, which is bigger by default than the original one
In many cases where there is a forced commit for durable workers (for example after remote writes), it does not commit
Even if it commits, it does that in the background, except in some "forced commit" situations.