search

openebs / zfs-localpv

Dynamically provision Stateful Persistent Node-Local Volumes & Filesystems for Kubernetes that is integrated with a backend ZFS data storage stack.
https://openebs.io
Apache License 2.0
422 stars 103 forks source link

utilize zfs replication to migrate PVs between nodes #291

Open artw opened 3 years ago

artw commented 3 years ago

zfs replication is pretty unique tool in the block storage world of OSS, why not utilize it for something awesome like that.

Some annotation to PVC, that would trigger a snapshot/replicate/delete source/ modify or recreate PV object.

pawanpraka1 commented 3 years ago

@artw you mean asynchronous replication? Why not use the velero and create the schedule to take the periodic backup?

Check this to migrate the pv to the other node https://github.com/openebs/zfs-localpv/blob/master/docs/backup-restore.md#restore-on-a-different-node.

artw commented 3 years ago

@artw you mean asynchronous replication? Why not use the velero and create the schedule to take the periodic backup?

Check this to migrate the pv to the other node https://github.com/openebs/zfs-localpv/blob/master/docs/backup-restore.md#restore-on-a-different-node.

I do, and it works quite well, thanks.

It would be much more effective to move the data between nodes directly utilizing the openebs-zfs-node daemonset.

To think of it further, you could even do it regulary to have HA PVs mirrored between all (or some) nodes 🤔

pawanpraka1 commented 3 years ago

@artw, sorry, I missed this thread. So basically, we need a data migration framework from one node to other without using velero. This can be done easily, as matter of the fact, velero already uses node daemonsets to backup/restore the data. We just need one operator which can help us to migrate the data from one node to other. This feature is in our roadmap.

mazocode commented 3 years ago

@pawanpraka1 It would be awesome to have something like syncoid integrated. This would make synchronization and moving PVs between nodes a breeze. We are using kubevirt which does not support live migration of local PV volumes but with something like syncoid it would require a quick reboot only. We're currently doing this for backups (snapshot replication of the PVs to dedicated backup servers).

almereyda commented 2 years ago

There is PR about the subject, which is not yet linked from here, nor does itself link to here:

It could possibly be considered a follow-up to @pawanpraka1 previous comment above.

avishnu commented 2 weeks ago

This will be picked up for discussion after the current backlog list is tackled. Community contributions will be definitely welcome.