how could I deal with that data amount is big?

hehefan / Unsupervised-Person-Re-identification-Clustering-and-Fine-tuning

219 stars 87 forks source link

how could I deal with that data amount is big? #5

Open BrettLL opened 7 years ago

BrettLL commented 7 years ago

when having amounts of unsupervised data, if I run the code, the memory is not enough for storing so many samples~ Is there a better solution to solve this problem?

hehefan commented 7 years ago

you need write a data generator by your self or use tensorflow (tf.Reader) directly.