General questions / info around the architecture.

[blmhemu]

I am looking into setting up a simple homelab and came across your amazing setup. Sorry for opening an issue. Could not find a better place to have a discussion (Let me know if there is one).

Coming to the questions,

• It looks like you have handpicked the storage folders for each device with ZFS datasets and nomad host volumes. It effectively pins the jobs to these nodes right ?
• How do you manage backups for these datasets (data and db as well) ? (snapshots ? nomad cron ?)
• How do you auto-unseal vault ?
• How do you deploy https://github.com/nahsi-homelab/nomad ? (levant or similar tool ?)

[nahsi]

@blmhemu Hello, thank you for the interest!

It looks like you have handpicked the storage folders for each device with ZFS datasets and nomad host volumes. It effectively pins the jobs to these nodes right ?

Unfortunately yes. It also makes it hard to add volumes, since I need to restart Nomad after adding a host volume. A better solution would be to setup host volumes with CSI that supports host volumes or to setup some sort of distributed storage. I've tried SeaweedFS but it was unreliable because it uses FUSE. So I'm building yet another server and will try out CEPH.

How do you manage backups for these datasets (data and db as well) ? (snapshots ? nomad cron ?)

To my great shame I've not setup any backups :) This, as well as alerting, is on my TODO list. Plan is to use specialized tool, if it exists, for every database. For PostgreSQL I will probably use wal-g, almost certainly running as periodic job in Nomad.

How do you auto-unseal vault?

Manually :( Was thinking of setting up AWS KMS since it is only 1$ per month.

How do you deploy https://github.com/nahsi-homelab/nomad ? (levant or similar tool ?)

Currently with nomad run although Nomad pack looks interesting.