search

deepset-ai / FARM

:house_with_garden: Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.
https://farm.deepset.ai
Apache License 2.0
1.73k stars 247 forks source link

Shuffle data between epochs in DataLoader #799

Closed Timoeller closed 3 years ago

Timoeller commented 3 years ago

Currently we do not shuffle the data between epochs.

I dont think this is meaningful in any case, so lets set the default mode to shuffling.

Timoeller commented 3 years ago

We actually pass the DataLoader a RandomSampler or DistributedSampler. So we should keep the default value for shuffling=False.