search

lipim12 / CS6140-ML-Doodle-Recognition

Machine Learning project for CS6140
0 stars 0 forks source link

Memory Error Issue #1

Open vrajesh978 opened 5 years ago

vrajesh978 commented 5 years ago 
train_X,valid_X,train_ground,valid_ground = train_test_split(train_data,
                                                             train_data,
                                                             test_size=0.2,
                                                             random_state=13)

It gives memory Error issue.

I think we can use keras generators to solve this.

lipim12 commented 5 years ago

train_test_split still needs to load the entire data in memory to shuffle. I doubt if the keras generator would help.