search

SpaceNetChallenge / utilities

Packages intended to assist in the preprocessing of SpaceNet satellite imagery data corpus to a format that is consumable by machine learning algorithms.
Other
248 stars 97 forks source link

Unable to download dataset from aws #79

Closed sumanth-culli closed 6 years ago

sumanth-culli commented 6 years ago

I'm unable to download most of the spacenet datasets. For e.g., when I'm trying to download the Las Vegas Building Training Dataset using the command aws s3api get-object --bucket spacenet-dataset --key AOI_2_Vegas/AOI_2_Vegas_Train.tar.gz --request-payer requester AOI_2_Vegas_Train.tar.gz, it's downloading partially (~70%) and I'm getting the error HTTPSConnectionPool(host='spacenet-dataset.s3.amazonaws.com', port=443): Read timed out.. It's happening for most of the datasets. I've tried tweaking the parameters as mentioned here but with no use. Kindly guide me.

dlindenbaum commented 6 years ago

Hello,

I am not sure how to help you. It looks like you are having trouble downloading the large files. This isn't something that we've had reporter before. What type of data connection are you working on?

Thank you,

sumanth-culli commented 6 years ago

Apparently, this has something to do with my ssh server in which I was trying to download. Downloading is fine in Google Cloud though. I still haven't figured out the problem with my server.