Downloading data - no access

[valeria-alex]

Hello,

I'm not sure if this is on purpose or a permission error when downloading the data:

HTTP request sent, awaiting response... 403 Forbidden 2019-11-11 11:23:18 ERROR 403: Forbidden.

It seems like I don't have access to the server here: http://ict.icrar.org/store/staff/cwu/rgz_data

Thank you for your time, In case this isn't a mistake, is there anything I can do to get access to the data?

I am working on an university project, feel free to ask for as many details as you wish.

edit: the only thing that downloads when running the download script is annotations.tar, but the system does not recognize it returning "this does not look like a tar file" when trying to work with it.

[ivyw]

Hi Valeria-alex,

Sorry about the link above not working. The new URL from which the data can be downloaded is as follows: https://cloudstor.aarnet.edu.au/plus/s/agKNekOJK87hOh0

Hope that this works better for you.

[valeria-alex]

Thank you so much! I got it working

I replaced the link in the script but still there were errors. However it worked when I downloaded all .tar and .tgz manually. I don't know if it's a problem in my setup or in the script.

Using dowloand_data.py I would always get this error:

raise Exception("fail to extract %s: %s" % (tar_file, msg))
Exception: fail to extract $PATH/D3/D3_model.tar: tar: This does not look like a tar archive
tar: Skipping to next header
tar: Exiting with failure status due to previous errors

or:

 raise Exception("fail to extract %s: %s" % (tar_file, msg))
 Exception: fail to extract $PATH/PNGImages/D3_images.tgz: 
 gzip: stdin: not in gzip format
 tar: Child returned status 1
 tar: Error is not recoverable: exiting now

so what I did was place the archive manually in the respective folder whenever the downloading script would stop and it was able to extract the files. Downloading it directly from the script results in a different type of file (?)

[ivyw]

I am glad that the download worked manually. I am not sure if it's your setup or the script. Just a guess but does the script work if you provided the full pathname rather than one with $PATH ?

[valeria-alex]

I have the full path, it downloads files of seemingly the proper type but then they are not recognized as that type

[ivyw]

Thanks for the confirmation valeria-alex. I think that you may be right and it might be the difference in setup then.

[qiuchenjian]

@ivyw hi, can you provide the d2 dataset , F dataset and W dataset ? i didn't find from https://cloudstor.aarnet.edu.au/plus/s/agKNekOJK87hOh0 thank you very much

[ivyw]

Hi @qiuchenjian I just checked and it seems that our cloudstor server is currently down. If possible can you wait a few days until it is back up again? I suspect that it is undergoing some maintenance. Sorry for the inconvenience.