durable workflow data - Githubissues

authzed / spicedb-kubeapi-proxy

Secure access to the Kubernetes API using SpiceDB

https://authzed.com/spicedb

Apache License 2.0

21 stars 0 forks source link

durable workflow data #18

Closed vroldanbet closed 10 months ago

vroldanbet commented 11 months ago

In https://github.com/authzed/spicedb-kubeapi-proxy/pull/16 dual-writes is addressed using a SAGA-like pattern using durable tasks. The state of the workflows is stored in an embedded SQLite which writes to local disk. If the pod is restarted, all state will be lost, which defuses the purposes of the durable task framework.

vroldanbet commented 11 months ago

Several options:

replace SQLite with whatever database we end up using for permission systems
Litestream
dqlite.io/
LiteFS

vroldanbet commented 10 months ago

Closed via https://github.com/authzed/spicedb-kubeapi-proxy/pull/34 Please read the PR body for the decision on how to make workflow data durable.

I we ever need to switch away from SQLite, I started working on a postgres backend implementation: https://github.com/vroldanbet/go-workflows/pull/1