search

SpaceNetChallenge / BuildingDetectors_Round2

Building detector algorithms from second SpaceNet Challenge
Other
192 stars 71 forks source link

Trouble downloading dataset on AWS #9

Closed Maxine3218 closed 3 years ago

Maxine3218 commented 3 years ago

Thank you for uploading this. The results all look very neat. However when I'm trying to replicate the results, I'm having trouble downloading the dataset to local disk and really don't know how to resolve this problem. Any help is sincerely appreciated.

I excute this from command line:

proxychains aws s3 cp s3://spacenet-dataset/spacenet/SN2_buildings/tarballs/SN2_buildings_train_AOI_5_Khartoum.tar.gz . --no-sign-request

It'll download just fine for a couple of minutes and then break (completed about 3.8G of this 4.7G file), indicating Errno 22 with Invalid Argument. I've also tried all other three trainning dataset but all encountered the same problem. I succeeded using the same command to download full AOI 3 – Paris – Building Extraction Testing (1.9G) and AOI 5 – Khartoum – Building Extraction Testing (1.6G).

download failed: s3://spacenet-dataset/spacenet/SN2_buildings/tarballs/SN2_buildings_train_AOI_5_Khartoum.tar.gz to ./SN2_buildings_train_AOI_5_Khartoum.tar.gz [Errno 22] Invalid argument

And this is my aws cli version etc.

aws-cli/1.18.69 Python/3.6.9 Linux/5.4.0-51-generic botocore/1.16.19

Maxine3218 commented 3 years ago

Dataset download is just fine on windows: aws-cli/1.19.33 Python/3.6.0 Windows/10 botocore/1.20.33 I think this might be trouble caused by difference between naming conventions between windows and linux?