jfilter / split-folders

🗂 Split folders with files (i.e. images) into training, validation and test (dataset) folders
MIT License
414 stars 72 forks source link

Need to split time series data into train/val/test, but cannot shuffle #44

Open Cavernoso opened 1 year ago

Cavernoso commented 1 year ago

As I am working with time series data, the information cannot be shuffled. Data volume is to big and therefore, I will use keras.train_on_batch since loading full dataset into RAM memory is not feasible. Spliting the data into train, test and validation folders would be helpfull. I am trying to use the split-folder library, but I could not identify how to avoid the shuffling process. Is it possible de-activate the shuffle?