Bump datasets from 1.15.1 to 2.12.0

[dependabot[bot]]

Bumps datasets from 1.15.1 to 2.12.0.

Release notes

Sourced from datasets's releases.

2.12.0

Datasets Features

• Add Dataset.from_spark by @​maddiedawson in huggingface/datasets#5701

  • Get a Dataset from a Spark DataFrame (docs):

  >>> from datasets import Dataset
  >>> ds = Dataset.from_spark(df)
  

• Support streaming Beam datasets from HF GCS preprocessed data by @​albertvillanova in huggingface/datasets#5689

  • Stream data from Wikipedia:

  >>> from datasets import load_dataset
  >>> ds = load_dataset("wikipedia", "20220301.de", streaming=True)
  >>> next(iter(ds["train"]))
  {'id': '1', 'url': 'https://de.wikipedia.org/wiki/Alan%20Smithee', 'title': 'Alan Smithee', 'text': 'Alan Smithee steht als Pseudonym für einen fiktiven Regisseur...}
  

• Implement sharding on merged iterable datasets by @​Hubert-Bonisseur in huggingface/datasets#5735

  • Use interleaved datasets in a distributed setup or with a DataLoader

  >>> from datasets import load_dataset, interleave_datasets
  >>> from torch.utils.data import DataLoader
  >>> wiki = load_dataset("wikipedia", "20220301.en", split="train", streaming=True)
  >>> c4 = load_dataset("c4", "en", split="train", streaming=True)
  >>> merged = interleave_datasets([wiki, c4], probabilities=[0.1, 0.9], seed=42, stopping_strategy="all_exhausted")
  >>> dataloader = DataLoader(merged, num_workers=4)
  

• Consistent ArrayND Python formatting + better NumPy/Pandas formatting by @​mariosasko in huggingface/datasets#5751

  • Return a list of lists instead of a list of NumPy arrays when converting the variable-shaped ArrayND to Python
  • Improve the NumPy conversion by returning a numeric NumPy array when the offsets are equal or a NumPy object array when they aren't
  • Allow converting the variable-shaped ArrayND to Pandas

General improvements and bug fixes

• Fix a description error for interleave_datasets. by @​QizhiPei in huggingface/datasets#5680
• [docs] Split pattern search order by @​stevhliu in huggingface/datasets#5693
• Raise an error on missing distributed seed by @​lhoestq in huggingface/datasets#5697
• Fix xnumpy_load for .npz files by @​albertvillanova in huggingface/datasets#5714
• Temporarily pin fsspec by @​albertvillanova in huggingface/datasets#5731
• Unpin fsspec by @​albertvillanova in huggingface/datasets#5733
• Fix CI warnings by @​albertvillanova in huggingface/datasets#5741
• Fix CI mock filesystem fixtures by @​albertvillanova in huggingface/datasets#5740
• Fix link in docs by @​bbbxyz in huggingface/datasets#5746
• fix typo: "mow" -> "now" by @​csris in huggingface/datasets#5763
• [docs] Compress data files by @​stevhliu in huggingface/datasets#5691
• Fix style by @​lhoestq in huggingface/datasets#5774
• Minor tqdm fixes by @​mariosasko in huggingface/datasets#5754
• Fixes #5757 by @​eli-osherovich in huggingface/datasets#5758
• Fix JSON builder when missing keys in first row by @​albertvillanova in huggingface/datasets#5772

... (truncated)

Commits

• 8e1af7b Release: 2.12.0 (#5803)
• e210dc2 Spark docs (#5796)
• 4bb172c Implement sharding on merged iterable datasets (#5735)
• a200ec9 Validate non-empty data_files (#5802)
• d06b8c2 Reorder default data splits to have validation before test (#5718)
• 3f9dfbd Fix inferring module for unsupported data files (#5787)
• f5f6c7e Change downloaded file permission based on umask (#5800)
• 5b011a2 Fix spark imports (#5795)
• cf4a195 Raise subprocesses traceback when interrupting (#5784)
• ea251c7 Add Dataset.from_spark (#5701)
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[dependabot[bot]]

Superseded by #170.