Bump datasets from 2.2.1 to 2.11.0

[dependabot[bot]]

Bumps datasets from 2.2.1 to 2.11.0.

Release notes

Sourced from datasets's releases.

2.11.0

Important

• Use soundfile for mp3 decoding instead of torchaudio by @​polinaeterna in huggingface/datasets#5573
  • this allows to not have dependencies on pytorch to decode audio files
  • this was possible with soundfile 0.12 which bundles libsndfile binaries at a recent version with MP3 support
• Deprecated batch_size on Dataset.to_dict()

Datasets Features

• Add writer_batch_size for ArrowBasedBuilder by @​lhoestq in huggingface/datasets#5565
  • allow to specofy the row group / record batch size when you download_and_prepare() a dataset
• Experimental support of cloud storage in load_dataset():
  • Support cloud storage in load_dataset via fsspec by @​dwyatte in huggingface/datasets#5580
  • Pass down storage options by @​dwyatte in huggingface/datasets#5673
• Support PyArrow arrays as column values in from_dict by @​mariosasko in huggingface/datasets#5643
• Allow direct cast from binary to Audio/Image by @​mariosasko in huggingface/datasets#5644
• Add column_names to IterableDataset by @​patrickloeber in huggingface/datasets#5582
• pass the dataset features to the IterableDataset.from_generator function by @​Hubert-Bonisseur in huggingface/datasets#5569
• add Dataset.to_list by @​kyoto7250 in huggingface/datasets#5611

General imrovements and bug fixes

• Update csv.py by @​XDoubleU in huggingface/datasets#5562
• Remove instructions for ffmpeg system package installation on Colab by @​polinaeterna in huggingface/datasets#5558
• Apply ruff flake8-comprehension checks by @​Skylion007 in huggingface/datasets#5549
• Fix datasets.load_from_disk, DatasetDict.load_from_disk and Dataset.load_from_disk by @​alvarobartt in huggingface/datasets#5529
• Add pre-commit config yaml file to enable automatic code formatting by @​polinaeterna in huggingface/datasets#5561
• Add huggingface_hub version to env cli command by @​mariosasko in huggingface/datasets#5578
• Do no write index by default when exporting a dataset by @​mariosasko in huggingface/datasets#5583
• Flatten dataset on the fly in save_to_disk by @​mariosasko in huggingface/datasets#5588
• Fix sort with indices mapping by @​mariosasko in huggingface/datasets#5587
• Fix docstring example by @​stevhliu in huggingface/datasets#5592
• Fix push_to_hub with no dataset_infos by @​lhoestq in huggingface/datasets#5598
• Don't compute checksums if not necessary in datasets-cli test by @​lhoestq in huggingface/datasets#5603
• Update README logo by @​gary149 in huggingface/datasets#5605
• Fix CI by temporarily pinning fsspec < 2023.3.0 by @​albertvillanova in huggingface/datasets#5617
• Fix archive fs test by @​lhoestq in huggingface/datasets#5614
• unpin fsspec by @​lhoestq in huggingface/datasets#5619
• Bump pyarrow to 8.0.0 by @​lhoestq in huggingface/datasets#5620
• Remove set_access_token usage + fail tests if FutureWarning by @​Wauplin in huggingface/datasets#5623
• Fix outdated verification_mode values by @​polinaeterna in huggingface/datasets#5607
• Adding Oracle Cloud to docs by @​ahosler in huggingface/datasets#5621
• Fix CI: ignore C901 ("some_func" is to complex) in ruff by @​polinaeterna in huggingface/datasets#5636
• add kwargs to index search by @​SaulLu in huggingface/datasets#5628
• Less zip false positives by @​lhoestq in huggingface/datasets#5640
• Allow self as key in Features by @​mariosasko in huggingface/datasets#5646
• Bump hfh to 0.11.0 by @​lhoestq in huggingface/datasets#5642
• Support streaming datasets with numpy.load by @​albertvillanova in huggingface/datasets#5626
• Fix unnecessary dict comprehension by @​albertvillanova in huggingface/datasets#5662
• Fix CI by temporarily pinning tensorflow < 2.12.0 by @​albertvillanova in huggingface/datasets#5664

... (truncated)

Commits

• 3b16e08 Release: 2.11.0 (#5684)
• 411f9cc Fix verification_mode when ignore_verifications is passed (#5683)
• 1520e01 Pass down storage options (#5673)
• c410d32 Allow loading/saving of FAISS index using fsspec (#5526)
• 50b887b add Dataset.to_list (#5611)
• 4db8e33 docs: Update num_shards docs to mention num_proc on Dataset and DatasetDict (...
• f423b69 Jax requires jaxlib (#5667)
• ea7298b Fix fsspec.open when using an HTTP proxy (#5656)
• b277cef Improve features decoding in to_iterable_dataset (#5655)
• 46bb11e Copy features (#5652)
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[dependabot[bot]]

Superseded by #27.