search

huggingface / datasets

🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools
https://huggingface.co/docs/datasets
Apache License 2.0
19.14k stars 2.66k forks source link

Datasets conflicts with fsspec 2024.9 #7190

Open cw-igormorgado opened 1 week ago

cw-igormorgado commented 1 week ago

Describe the bug

Installing both in latest versions are not possible

pip install "datasets==3.0.1" "fsspec==2024.9.0"

But using older version of datasets is ok

pip install "datasets==1.24.4" "fsspec==2024.9.0"

Steps to reproduce the bug

pip install "datasets==3.0.1" "fsspec==2024.9.0"

Expected behavior

install both versions.

Environment info

debian 11. python 3.10.15

geekodour commented 2 days ago

Yes, I need to use the latest version of fsspec and datasets for my usecase. https://github.com/fsspec/s3fs/pull/888#issuecomment-2404204606 https://github.com/apache/arrow/issues/34363#issuecomment-2403553473

last version where things install without conflict is: 2.14.4

So this issue starts from: https://github.com/huggingface/datasets/releases/tag/2.14.5