neuroailab / tfutils

Utilities for working with tensorflow
MIT License
25 stars 8 forks source link

handle train/test slices in hdf5 file for Imagenet #14

Closed yamins81 closed 7 years ago

yamins81 commented 8 years ago

Two options for doing this:

1) three separate datasubsets (keys in the hdf5 file), one for train, one for validation, one for testing

2) one large hdf5 file but three subslice keys (e.g. lists of indices in to the big data file, each stored as an hdf5 array), one for train, one for validation, one for testing