search

systemd / casync

Content-Addressable Data Synchronization Tool
1.49k stars 117 forks source link

Project is dead, please put that info on main page #259

Closed om26er closed 1 year ago

om26er commented 2 years ago

There is a working, alternate implementation on casync which is well maintained and is faster in terms of creating chunks and downloading due to parallelization. https://github.com/folbricht/desync

I hope the project's home page can mention that

agambier commented 1 year ago

I'm facing issue on an embedded system #260. If the project is dead it would be great to mention it so we switch to another tool or if someone has the time he could maintain it.

ejoerns commented 1 year ago

Especially for embedded and when only images need to be synchronized, there is also

https://github.com/florolf/casync-nano

which can also serve as a drop-in replacement for some cases.

agambier commented 1 year ago

thanks

casync-nano is aleady in my list of tools to evaluate.

bluca commented 1 year ago

It's not dead, a bit slow moving for now, but we will probably get to this again after some more work in other areas is complete. Some PRs that were pending were merged recently, if you have any other bug fixes or features you'd like to contribute please open a PR.

agambier commented 1 year ago

Thanks for the reply ! Good to know it's still alive :)

safinaskar commented 1 year ago

Okay, it seems that this issue serves as list of casync alternatives. So here is my own simplistic parallel casync alternative, written in Rust, which uses fixed sized chunking (which is great for VM images): https://github.com/borgbackup/borg/issues/7674#issuecomment-1654175985 . You can also see there benchmark, which compares my tool to casync, desync and other alternatives. And my tool is way faster than all them. (But I cheat by using fixed sized chunking). See whole issue for context and especially this comment https://github.com/borgbackup/borg/issues/7674#issuecomment-1656787394 for comparison between casync, desync and other CDC-based tools

safinaskar commented 1 year ago

Okay, so here is list of Github issues I ~spammed~ wrote in last few days on this topic (i. e. fast fixed-sized and CDC-based deduplication). I hope they provide great insight to everyone interested in fast deduplicated storage. https://github.com/borgbackup/borg/issues/7674 https://github.com/systemd/casync/issues/259 https://github.com/folbricht/desync/issues/243 https://github.com/ipfs/specs/issues/227 https://github.com/dpc/rdedup/discussions/222 https://github.com/opencontainers/umoci/issues/256