search

IGS / portal_client

Python-based client for downloading data made available through portals powered by the GDC-based portal system..
MIT License
16 stars 17 forks source link

Unable to download some files in HMP #27

Open diyabasu97 opened 4 months ago

diyabasu97 commented 4 months ago

Hi, I was trying to download data from HMP data portal. However, I observed that for some files I am able to download the file using the download button given whereas for some other files I am not able to do so. For example, for the following file if I click on the download button nothing happens and if I copy and paste the https url in the browser then an error comes up saying forbidden request. https://portal.hmpdacc.org/files/1670203039de370df9a35a043733fb44

Why is it so? Is it some problem with the file or some access issue which I don't have. Can you please guide me with this. Thanks in advance.

Regards, Diya.

nsuvarnaiari commented 4 months ago

Hi Diya,

The data you are interested in is freely available for download from our AWS S3 bucket. Bucket name: hmpdcc Path: s3://hmpdcc/hmp1/hhs/microbiome/wms/analysis/metabolic_prof/humann1_2012/compressed_files/ You will be able to access HMP and iHMP data from the bucket.

Thanks, Suvvi

diyabasu97 commented 4 months ago

Hi Suvvi,

Thank you for your quick response. However, when I try to access this s3 bucket it asks me for AWS access key ID and AWS secret access key. Can you please help me with these details as well. Thank you.

Regards, Diya

nsuvarnaiari commented 4 months ago

Hi Diya,

Try this. Note the flag in the command, that will let you access the files without a key. aws s3 cp s3://hmpdcc/hmp1/hhs/microbiome/wms/analysis/metabolic_prof/humann1_2012/compressed_files/SRS013261_vs_KEGG_v54.tar.bz2 . --no-sign-request

Thanks, Suvvi

diyabasu97 commented 4 months ago

Hi Suvvi,

Thank you I was able to access the s3 bucket link and get the copy of the file in my local. Thank you for your help and support.

Regards, Diya