microsoft / Oscar

Oscar and VinVL
MIT License
1.03k stars 248 forks source link

Azcopy failes with given SAS token #209

Open meharbhatia opened 8 months ago

meharbhatia commented 8 months ago

I am using the given SAS token to extract this YAML file

coco_flickr30k_googlecc_gqa_sbu_oi_x152c4big2exp168.yaml

./azcopy copy "https://biglmdiag.blob.core.windows.net/vinvl/pretrain_corpus/coco_flickr30k_googlecc_gqa_sbu_oi_x152c4big2exp168.yaml?sp=r&st=2023-08-28T01:12:41Z&se=3023-08-28T09:12:41Z&sv=2022-11-02&sr=c&sig=6R1YmWluiXmPLsdVn1rDUpeBp2SYBMxDjc6KoKNlY8Q%3D" data/ --recursive

but face the issue.

INFO: Scanning...
INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support

failed to perform copy command due to error: cannot start job due to error: cannot list files due to reason HEAD https://biglmdiag.blob.core.windows.net/vinvl/pretrain_corpus/coco_flickr30k_googlecc_gqa_sbu_oi_x152c4big2exp168.yaml
--------------------------------------------------------------------------------
RESPONSE 403: 403 Server failed to authenticate the request. Make sure the value of Authorization header is formed correctly including the signature.
ERROR CODE: AuthenticationFailed
--------------------------------------------------------------------------------
Response contained no body
--------------------------------------------------------------------------------

Can anyone help me resolve this? @xjli @ChunyuanLI @xiyinmsu @pzzhang. My work needs access to the VinVL files and I am stuck currently.

Aashish75 commented 5 months ago

@meharbhatia were you able to find a fix for this? I am also unable to download the model checkpoints as per the instructions in the https://github.com/microsoft/Oscar/blob/master/VinVL_DOWNLOAD.md file. Getting the same error.

zzk2021 commented 1 month ago

yes , my work also report AuthenticationFailed, how to fix it?

ivebarna commented 2 weeks ago

I also meet this problem, do you know how to solve it?

Mi1an commented 1 week ago

Okay I had the same error. After a few attempts I noticed that I miss "?" character in my script after the name of a blob and before the SAS token. I had this in my input parameters: ".vhdse=2024" It should be this: ".vhd?se=2024"

After I fixed that it was working again.

pzzhang commented 1 week ago

Currently only the VinVL vision encoder model can be downloaded from an updated google link. We do not provide extracted features any more. If you need image features, you need to run the VinVL vision encoder model to extract features by yourselves. Sorry for the inconvenience!