The "dataset-hub-cache" and "dataset-is-valid" steps should always return a value

huggingface / dataset-viewer

Lightweight web API for visualizing and exploring any dataset - computer vision, speech, text, and tabular - stored on the Hugging Face Hub

https://huggingface.co/docs/datasets-server

Apache License 2.0

639 stars 65 forks source link

The "dataset-hub-cache" and "dataset-is-valid" steps should always return a value #2918

Closed severo closed 2 weeks ago

severo commented 2 weeks ago

For example, we detect that the dataset nkp37/OpenVid-1M has Image and Video modalities (steps dataset-filetypes and dataset-modalities), but because the datasets library fails to list the configs, the following steps also return an error.

severo commented 2 weeks ago

Also: should we merge the "dataset-hub-cache" and "dataset-is-valid" steps?