Grouped partitions

[clementfarabet]

It would be nice to have a system of grouped partitions, useful for creating splits on the fly (training/validation):

trainingPartition = {
   partitions = 10
   partition = {1,2,3,4,5,6,7,8,9}
}
validationPartition = {
   partitions = 10
   partition = {10}
}

[egonina]

@clementfarabet do you want the files to be round-robined to partitions or is it ok to split them into chunks sequentially?

[clementfarabet]

Closing – this overloading of partitions is too confusing.