search

skyplane-project / skyplane

🔥 Blazing fast bulk data transfers between any cloud 🔥
https://skyplane.org
Apache License 2.0
999 stars 58 forks source link

[bug] hangs #934

Open matti opened 2 months ago

matti commented 2 months ago 
/  ___| | / /\ \ / / ___ \ |     / _ \ | \ | ||  ___|
\ `--.| |/ /  \ V /| |_/ / |    / /_\ \|  \| || |__  
 `--. \    \   \ / |  __/| |    |  _  || . ` ||  __| 
/\__/ / |\  \  | | | |   | |____| | | || |\  || |___ 
\____/\_| \_/  \_/ \_|   \_____/\_| |_/\_| \_/\____/

Azure resource group and UMI name not configured correctly. Please reinit Azure with `skyplane init --reinit-azure`.
Logging to: /tmp/skyplane/transfer_logs/20240623_172815-3822f766/client.log
Using Skyplane version 0.3.2
Will transfer objects from gcp:europe-north1-a to aws:eu-north-1
VMs to provision: 8x aws:eu-north-1, 8x gcp:europe-north1-a
Estimated egress cost: $0.12/GB
gs://source/bukee/01e06fd2-4c5d-424d-82e8-53b67e3f948a/job-3159.json => 
s3://dest/bukee/01e06fd2-4c5d-424d-82e8-53b67e3f948a/job-3159.json (1.45KB)
gs://source/bukee/03c3d4c6-4485-4100-ab46-b934cbb8dfe4/job-523.json => 
s3://dest/bukee/03c3d4c6-4485-4100-ab46-b934cbb8dfe4/job-523.json (1.51KB)
gs://source/bukee/0626b757-84d7-4b5a-91e6-4a4ee29e1f52/job-3239.json => 
s3://dest/bukee/0626b757-84d7-4b5a-91e6-4a4ee29e1f52/job-3239.json (1.43KB)
gs://source/bukee/06b1387f-143b-484f-b37c-59c25c114a71/job-510.json => 
s3://dest/bukee/06b1387f-143b-484f-b37c-59c25c114a71/job-510.json (1.49KB)
gs://source/bukee/0800bb2f-fc2f-4876-af08-c9dee4ee6ffe/job-513.json => 
s3://dest/bukee/0800bb2f-fc2f-4876-af08-c9dee4ee6ffe/job-513.json (1.50KB)
...
Transfer starting

and then nothing

matti commented 2 months ago

okay, didn't was just extremely slow. python consumed 23% cpu on one thread.