`kedro-datasets`: Nightly build failure

E RuntimeError: Failed to import transformers.pipelines because of the following error (look up to see its traceback): E cannot import name 'split_torch_state_dict_into_shards' from 'huggingface_hub' (/workspace/kedro-plugins/.venv/lib/python3.10/site-packages/huggingface_hub/init.py)

I can reproduce this when I run pip install .[test]. This does not happen when I run pip install .[huggaceface]. It could be some secondary dependencies issue.

noklam commented 2 months ago

pip install .[huggingface] -> huggingface-hub 0.24.3

pip install .[test] - > huggingface-hub 0.17.3

noklam commented 2 months ago

a new failing doctest now

/home/runner/work/kedro-plugins/kedro-plugins/kedro-datasets/kedro_datasets/huggingface/hugging_face_dataset.py:31: DocTestFailure
=========================== short test summary info ============================
FAILED kedro_datasets/huggingface/hugging_face_dataset.py::kedro_datasets.huggingface.hugging_face_dataset.HFDataset

github-actions[bot] commented 2 months ago

GitHub Actions workflow Run nightly tests on all plugins #310 failed.

github-actions[bot] commented 2 months ago

GitHub Actions workflow Run nightly tests on all plugins #311 failed.