Describe the bug
I am transferring a large 135 GB file from AWS to GCP, however instead a 62.5 GB file appears in GS and the transfer validation failes.
To Reproduce
Run skyplane cp s3://glisten-datasets/allparel-images/ILSVRC2012_img_train.tar gs://glisten-dataset/allparel-images/ -n 8
Expected behavior
Successfully transfer of full file.
Describe the bug I am transferring a large 135 GB file from AWS to GCP, however instead a 62.5 GB file appears in GS and the transfer validation failes.
To Reproduce Run
skyplane cp s3://glisten-datasets/allparel-images/ILSVRC2012_img_train.tar gs://glisten-dataset/allparel-images/ -n 8
Expected behavior Successfully transfer of full file.
Screenshots
Client Log client.log
Environment info (please complete the following information):