I am interested in using your datasets but they are all too large to fit on my machine. On way around this would be to use the Hugging Face Datasets library, which allows you to stream the dataset input. However, it seems like to upload them to the Hub you first must have the files downloaded locally in the first place. Is it possible for you to add these datasets to the Hub? Thanks in advance.
I am interested in using your datasets but they are all too large to fit on my machine. On way around this would be to use the Hugging Face Datasets library, which allows you to stream the dataset input. However, it seems like to upload them to the Hub you first must have the files downloaded locally in the first place. Is it possible for you to add these datasets to the Hub? Thanks in advance.