Bump datasets from 2.2.1 to 2.8.0

[dependabot[bot]]

Bumps datasets from 2.2.1 to 2.8.0.

Release notes

Sourced from datasets's releases.

2.8.0

Important

• Removed YAML integer keys from class_label metadata by @​albertvillanova in huggingface/datasets#5277
  • From now on, datasets pushed on the Hub and using ClassLabel will use a new YAML model to store the feature types
  • The new model uses strings instead of integers for the ids in label name mapping (e.g. 0 -> "0"). This is due to the Hub limitations. In a few months the Hub may stop allowing users to push the old YAML model.
  • Old versions of datasets are not able to reload datasets pushed with this new model, so we encourage everyone to update.

Datasets Features

• Fix methods using IterableDataset.map that lead to features=None by @​alvarobartt in huggingface/datasets#5287
  • Datasets in streaming mode now update their features after column renaming or removal
• Add num_proc to from_csv/generator/json/parquet/text by @​lhoestq in huggingface/datasets#5239
  • Use multiprocessing to load multiple files in parallel
• Add features param to IterableDataset.map by @​alvarobartt in huggingface/datasets#5311
• Sharded save_to_disk + multiprocessing by @​lhoestq in huggingface/datasets#5268
  • Pass num_shards or max_shard_size to ds.save_to_disk() or ds.push_to_hub()
  • Pass num_proc to use multiprocessing.
• Support for decoding Image/Audio types in map when format type is not default one by @​mariosasko in huggingface/datasets#5252
• Support torch dataloader without torch formatting for IterableDataset by @​lhoestq in huggingface/datasets#5357
  • You can now pass any dataset in streaming mode to a PyTorch DataLoader directly:

  from datasets import load_dataset
  ds = load_dataset("c4", "en", streaming=True, split="train")
  dataloader = DataLoader(ds, batch_size=32, num_workers=4)
  

Docs

• Complete doc migration by @​mishig25 in huggingface/datasets#5248

General improvements and bug fixes

• typo by @​WrRan in huggingface/datasets#5253
• typo by @​WrRan in huggingface/datasets#5254
• remove an unused statement by @​WrRan in huggingface/datasets#5257
• fix wrong print by @​WrRan in huggingface/datasets#5256
• Fix max_shard_size docs by @​lhoestq in huggingface/datasets#5267
• Specify arguments as keywords in librosa.reshape to avoid future errors by @​polinaeterna in huggingface/datasets#5266
• Change release procedure to use only pull requests by @​albertvillanova in huggingface/datasets#5250
• Warn about checksums by @​lhoestq in huggingface/datasets#5279
• Tweak readme by @​lhoestq in huggingface/datasets#5210
• Save file name in embed_storage by @​lhoestq in huggingface/datasets#5285
• Use correct dataset type in from_generator docs by @​mariosasko in huggingface/datasets#5307
• Support streaming datasets with pathlib.Path.with_suffix by @​albertvillanova in huggingface/datasets#5294
• Fix xjoin for Windows pathnames by @​albertvillanova in huggingface/datasets#5297
• Fix xopen for Windows pathnames by @​albertvillanova in huggingface/datasets#5299
• Ci py3.10 by @​lhoestq in huggingface/datasets#5065
• Update Overview.ipynb google colab by @​lhoestq in huggingface/datasets#5211
• Support xPath for Windows pathnames by @​albertvillanova in huggingface/datasets#5310

... (truncated)

Commits

• 037c9b5 Release: 2.8.0 (#5375)
• 4403d06 Simplify skipping (#5373)
• 78da5c3 Align remove columns behavior and input dict mutation in map with previous ...
• 0cad393 Fix remove columns from lazy dict (#5367)
• 0bec9f3 Support torch dataloader without torch formatting (#5357)
• 53c563c ExamplesIterable fixes (#5366)
• 232a439 Sharded save_to_disk + multiprocessing (#5268)
• cdc20c0 Clean filesystem and logging docstrings (#5356)
• 4377c5b Raise error for .tar archives in the same way as for .tar.gz and .tgz i...
• c902456 Clean up Table class docstrings (#5355)
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[dependabot[bot]]

Superseded by #9.