Open meanii opened 12 months ago
Hi @meanii thanks for reporting this - If you don't mind sharing, about how many files are you trying to transfer and what size are they? Also, how long did it take before the crash happened?
Hi @meanii thanks for reporting this - If you don't mind sharing, about how many files are you trying to transfer and what size are they? Also, how long did it take before the crash happened?
Over 170 TB of data
Do you know what the file sizes tend to me? For small files, you may want use n=1
for the number of VMs, since the bottleneck will be in listing the files.
Describe the bug A clear and concise description of what the bug is.
To Reproduce Steps to reproduce the behavior (please include the full Skyplane command you ran): error encountered in: skyplane cp -r gs://AAAAAAA/ s3://BBBBBBBBB/ -n 8
Screenshots
Transfer client log
Environment info (please complete the following information):