oetiker / znapzend

zfs backup with remote capabilities and mbuffer integration.
www.znapzend.org
GNU General Public License v3.0
608 stars 137 forks source link

znapzend slow down horribly #403

Closed mpicjohn closed 3 years ago

mpicjohn commented 5 years ago

Hi everybody,

we run znapzend for some time now on (on OpenIndiana servers) to do local snapshots and send them to a remote server.

On one server we experience severe lags from time to time, that stop as soon as we disable the znapzend service.

The sever helds about 500TB of disks (one pool with about 450TB brutto HDDs, one with about 50TB of SSDs). The data is spread across roughly 2000 individual ZFS filesystems.

Do we hit some sort of a critical size?

thx for suggestions

Carsten

moetiker commented 5 years ago

I don't think there is a limit. only very large remove lists might be a problem. you can check you destroy lists with znapzend --debug

mpicjohn commented 5 years ago

We have a debug log running and can't see any issues regarding cleanups... I'll try to look deeper into this.

stale[bot] commented 3 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.