fff-rs / juice-examples

Examples for the Hacker's Machine Learning Framework Juice which are guaranteed to work for release tags.
8 stars 5 forks source link

fix/download: use https to avoid dealing with 301 headers #11

Closed drahnr closed 7 years ago

drahnr commented 7 years ago

Closes #10

subversive-owl commented 7 years ago

i feel merge conflicts coming on... :p

drahnr commented 7 years ago

Yep, definitley - but in this case no big deal

drahnr commented 7 years ago

@subversive-owl please check if this still works as intended.

subversive-owl commented 7 years ago

I think the download is breaking on fashion-MNIST. Updating shortly with MD5 hashes...

hashes of program download

7edbbf1fc824916c442268ac4dc845cd  - ./t10k-images-idx3-ubyte.gz.md5
b9859d5936603c782c6eb8dd14198360  - ./t10k-labels-idx1-ubyte.gz.md5
053aba987904a004d52cb333753041a3  - ./train-images-idx3-ubyte.gz.md5
7864864ad9592b0ffcc53c942eb67b24  - ./train-labels-idx1-ubyte.gz.md5

manually downloaded from repo S3 link

7edbbf1fc824916c442268ac4dc845cd  - ./t10k-images-idx3-ubyte.gz.md5
b9859d5936603c782c6eb8dd14198360  - ./t10k-labels-idx1-ubyte.gz.md5
053aba987904a004d52cb333753041a3  - ./train-images-idx3-ubyte.gz.md5
7864864ad9592b0ffcc53c942eb67b24  - ./train-labels-idx1-ubyte.gz.md5

downloaded from repo directly

bef4ecab320f06d8554ea6380940ec79  - ./t10k-images-idx3-ubyte.gz.md5
bb300cfdad3c16e7a12a480ee83cd310  - ./t10k-labels-idx1-ubyte.gz.md5 
8d4fb7e6c68d591d4c3dfef9ec88bf0d  - ./train-images-idx3-ubyte.gz.md5
25c81989df183df01b3e8a0aad5dffbe  - ./train-labels-idx1-ubyte.gz.md5

It looks like the S3 bucket is not providing files properly.

subversive-owl commented 7 years ago

The MNIST downloader seems to be cutting off the data sets, because it drops it before it reaches full size.

program downloaded hashes

16814998f5124c5092453d508909bfc1  - ./mnist_test.csv.md5
3d9943019997692dd4faf72b7469d52c  - ./mnist_train.csv.md5

manually downloaded hashes

c807df8d6d804ab2647fc15c3d40f543  - ./mnist_test.csv.md5 
5b49cf1b57fb9d6102b559d59d99df7c  - ./mnist_train.csv.md5
drahnr commented 7 years ago

@subversive-owl see #13 for a final resolution, I have yet to rebase it