juditacs / morph-segmentation

Experimenting with supervised morphological segmentation
MIT License
6 stars 5 forks source link

Ensure all data splits contain at least one sample #3

Closed juditacs closed 7 years ago

juditacs commented 7 years ago

This is important when using toy datasets. Valid and test splits can easily end up empty.

I'll probably change the sampling method to fixed sized samples instead of random sampling and using threshold.