search

apple / corenet

CoreNet: A library for training deep neural networks
Other
6.72k stars 518 forks source link

Streaming HuggingFace Datasets #36

Open Wonder1905 opened 1 month ago

Wonder1905 commented 1 month ago

Hi, is there a possibility to adjust the code such that downloading the datasets is not necessary but streaming HuggingFace datasets. Even high-level guidelines would be nice!