search

skyplane-project / skyplane

🔥 Blazing fast bulk data transfers between any cloud 🔥
https://skyplane.org
Apache License 2.0
1.09k stars 62 forks source link

benchmarking agains fpart, rclone ? #726

Closed truatpasteurdotfr closed 1 year ago

truatpasteurdotfr commented 1 year ago

Hello

You have benchmarked against rsync but what would skyplane compare with fpart (http://www.fpart.org/fpart/ ) or objet data movers such as rclone (https://rclone.org/ ) ?

Best regards

Tru

sarahwooders commented 1 year ago

Skyplane will create multiple VM instances to execute large data transfers in parallel across multiple machines, while I believe tools like rclone still run transfers from your local machine but provide a unified interface. So you would probably see similar performance gains with Skyplane over the AWS CLI and rclone (up to 110X) depending on your object sizes and the number of VMs you use with Skyplane.

truatpasteurdotfr commented 1 year ago

ok thanks for your input, closing the issue.

Best regards

Tru