Right now we have an encoded dataset index file, huggingface_data/huggingface_datasets/huggingface_datasets_datafinder_index, checked in to the repository. Instead of having a binary in our repo, it would be better to download this from a server if it's missing.
Right now we have an encoded dataset index file,
huggingface_data/huggingface_datasets/huggingface_datasets_datafinder_index
, checked in to the repository. Instead of having a binary in our repo, it would be better to download this from a server if it's missing.