huggingface / chug

Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.
Apache License 2.0
151 stars 10 forks source link

Improving seed handling for sample shuffle so can be deterministic. #5

Closed rwightman closed 6 months ago