Bump datasets from 1.15.1 to 2.13.0

[dependabot[bot]]

Bumps datasets from 1.15.1 to 2.13.0.

Release notes

Sourced from datasets's releases.

2.13.0

Dataset Features

• Add IterableDataset.from_spark by @​maddiedawson in huggingface/datasets#5770

  • Stream the data from your Spark DataFrame directly to your training pipeline

  from datasets import IterableDataset
  from torch.utils.data import DataLoader
  ids = IterableDataset.from_spark(df)
  ids = ids.map(...).filter(...).with_format("torch")
  for batch in DataLoader(ids, batch_size=16, num_workers=4):
  ...
  

• IterableDataset formatting for PyTorch, TensorFlow, Jax, NumPy and Arrow:

  • IterableDataset Arrow formatting by @​lhoestq in huggingface/datasets#5821
  • Iterable torch formatting by @​lhoestq in huggingface/datasets#5852

  from datasets import load_dataset
  ids = load_dataset("c4", "en", split="train", streaming=True)
  ids = ids.map(...).with_format("torch")  # to get PyTorch tensors - also works with tf, np, jax etc.
  

• Add IterableDataset.from_file to load local dataset as iterable by @​mariusz-jachimowicz-83 in huggingface/datasets#5893

  from datasets import IterableDataset
  ids = IterableDataset.from_file("path/to/data.arrow")
  

• Arrow dataset builder to be able to load and stream Arrow datasets by @​mariusz-jachimowicz-83 in huggingface/datasets#5944

  from datasets import load_dataset
  ds = load_dataset("arrow", data_files={"train": "train.arrow", "test": "test.arrow"})
  

Experimental

• Add parallel module using joblib for Spark by @​es94129 in huggingface/datasets#5924

General improvements and bug fixes

• Preserve stopping_strategy of shuffled interleaved dataset (random cycling case) by @​mariosasko in huggingface/datasets#5816
• Fix incomplete docstring for BuilderConfig by @​Laurent2916 in huggingface/datasets#5824
• [docs] Custom decoding transforms by @​stevhliu in huggingface/datasets#5836
• Add accelerate as metric's test dependency to fix CI error by @​mariosasko in huggingface/datasets#5848
• Add date_format param to the CSV reader by @​mariosasko in huggingface/datasets#5845

... (truncated)

Commits

• 9aaee6f Release: 2.13.0 (#5957)
• 650a86e Fix sequence of array support for most dtype (#5948)
• f1911ff Add Arrow builder docs (#5952)
• 9e40d28 Fix ArrowExamplesIterable.shard_data_sources (#5956)
• d536e37 Make get_from_cache use custom temp filename that is locked (#5938)
• 7845d4c Better filenotfound for gated (#5954)
• 78b4d55 Avoid parallel redownload in cache (#5937)
• accaaf2 Add parallel module using joblib for Spark (#5924)
• 443fc92 Arrow dataset builder to be able to load and stream Arrow datasets (#5944)
• 963ff6d Iterable torch formatting (#5852)
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[dependabot[bot]]

Superseded by #172.