mila-iqia / fuel

A data pipeline framework for machine learning
MIT License
867 stars 268 forks source link

CelebA Dataset: dropbox unstable #396

Open kyunghyuncho opened 7 years ago

kyunghyuncho commented 7 years ago

Dropbox link to CelebA is quite unstable. It would be awesome if Fuel support downloading from their Google Drive link: http://mmlab.ie.cuhk.edu.hk/projects/CelebA.html

charlesreid1 commented 7 years ago

Note that this is not as straightforward as replacing the Dropbox link with the Google Drive link, as Google Drive makes it a little more tricky to automatically download files > 1 GB.

See this Stack Overflow question: "wget curl large file from google drive" for some Python code. The code provided works (see this gist), but some of the code seems a bit out of scope. Perhaps download_file_from_google_drive() could go into fuel as a utility function/class?

cantren commented 7 years ago

Thanks for the wget curl link!

On Sat, Oct 14, 2017 at 5:10 PM, C Reid notifications@github.com wrote:

Note that this is not as straightforward as replacing the Dropbox link with the Google Drive link, as Google Drive makes it a little more tricky to automatically download files > 1 GB.

See this Stack Overflow question: "wget curl large file from google drive" https://stackoverflow.com/questions/25010369/wget-curl-large-file-from-google-drive#39225039 for some Python code.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/mila-udem/fuel/issues/396#issuecomment-336676340, or mute the thread https://github.com/notifications/unsubscribe-auth/ABZN_rKvw5TuFiShMlpHFZLrrfg6YdW5ks5ssU10gaJpZM4NbE6H .