Computer-Vision-in-the-Wild / DataDownload

MIT License
23 stars 4 forks source link

"Public access is not permitted on this storage account." #9

Open JackUrb opened 1 year ago

JackUrb commented 1 year ago

It seems like there's no longer allowed public access to the bucket at https://cvinthewildeus.blob.core.windows.net/datasets/classification. Is this intentional, are the Elevater files no longer being hosted?

ChunyuanLI commented 1 year ago

Note: The data is on Azure Storage Blob, a SAS with Read permission is provided. Please append the following SAS at the end of each link to download:

?sp=r&st=2023-08-28T01:41:20Z&se=3023-08-28T09:41:20Z&sv=2022-11-02&sr=c&sig=Msoq5dIl%2Fve6F01edGr8jgcZUt7rtsuJ896xvstSNfM%3D
JackUrb commented 1 year ago

Thanks for this, this worked.

For anyone who is running into the same issue, I made sure to pip install vision_datasets==0.2.29 (as 1.0 onwards has a different api), then updated classification/download_datasets.py:19 to the following:

downloader = DatasetDownloader('https://cvinthewildeus.blob.core.windows.net/datasets?sp=r&st=2023-08-28T01:41:20Z&se=3023-08-28T09:41:20Z&sv=2022-11-02&sr=c&sig=Msoq5dIl%2Fve6F01edGr8jgcZUt7rtsuJ896xvstSNfM%3D', hub.dataset_registry)

The download_datasets.py script then works as intended.

haotian-liu commented 1 year ago

@JackUrb Thank you. We have updated the readme to use the fixed version number vision-datasets==0.2.17.

sungonce commented 10 months ago

@ChunyuanLI @haotian-liu

I would like to thank you for sharing such a valuable dataset. While attempting to download the knowledge files for classification datasets (classification/download_knowledge.py), I encountered a problem. It appears that public access to the bucket located at "https://elevater.blob.core.windows.net/resources" may no longer be permitted. Could you please confirm if you have an active SAS for this bucket?