How to download the dataset from command line？

[vinthony]

Hi Afifi,

Thanks for your awesome work! It inspires me a lot!

I try to download the dataset, however, it seems to be difficult to download from the command line.

Because I can only access the command line from the GPU server.

Any advice for downloading the dataset from sync, it is possible to download from the command line?

Or it is possible to have the google drive link?

Thanks, Xiaodong Cun

[mahmoudnafifi]

Hi Xiaodong,

Thank you for your interest.

Currently, Sync does not provide a solution to this problem. Though it is tedious a bit, I suggest downloading it in your device and then you can upload it into the server.

[vinthony]

Thanks for your response.

I will try to download it as you suggested.

[mahmoudnafifi]

Hi @vinthony ,

I wonder, did you solve the problem? Did you face any problem with unzipping the files in Linux? I am asking because I got some complaints regarding the same point.

Thanks!

[vinthony]

@mahmoudnafifi hi, I downloaded the dataset from the GUI and uploaded the whole datasets to the server. I do not face any unzipping problems in Linux(maybe I forgot), but it seems the original dataset has missed some files when I try to train the https://github.com/mahmoudnafifi/Deep_White_Balance.

Thus, I add the below codes in dataset.py to check the existence of 'G_AS.png', 'T_AS.png', 'S_AS.png' before this line

files = []
for i in range(len(tmpfiles)):
      x1 = exists(imgs_dir + tmpfiles[i][0][0].replace('*','T_AS.png'))
      x2 = exists(imgs_dir + tmpfiles[i][0][0].replace('*','G_AS.png'))
      x3 = exists(imgs_dir + tmpfiles[i][0][0].replace('*','S_AS.png'))
      if x1 and x2 and x3:
          files.append(tmpfiles[i])

[mahmoudnafifi]

@vinthony Thank you very much for sharing this code. I uploaded Set1 as a single Zip file (also there is a Google drive mirror). Yes, not all images have all WB settings. So, your code will help people to use it. I will refer any related issues to it. Thanks again!