Bump datasets from 2.20.0 to 3.1.0

[dependabot[bot]]

Bumps datasets from 2.20.0 to 3.1.0.

Release notes

Sourced from datasets's releases.

3.1.0

Dataset Features

• Video support by @​lhoestq in huggingface/datasets#7230

  >>> from datasets import Dataset, Video, load_dataset
  >>> ds = Dataset.from_dict({"video":["path/to/Screen Recording.mov"]}).cast_column("video", Video())
  >>> # or from the hub
  >>> ds = load_dataset("username/dataset_name", split="train")
  >>> ds[0]["video"]
  <decord.video_reader.VideoReader at 0x105525c70>
  

• Add IterableDataset.shard() by @​lhoestq in huggingface/datasets#7252

  >>> from datasets import load_dataset
  >>> full_ds = load_dataset("amphion/Emilia-Dataset", split="train", streaming=True)
  >>> full_ds.num_shards
  2360
  >>> ds = full_ds.shard(num_shards=ds.num_shards, index=0)
  >>> ds.num_shards
  1
  >>> ds = full_ds.shard(num_shards=8, index=0)
  >>> ds.num_shards
  295
  

• Basic XML support by @​lhoestq in huggingface/datasets#7250

What's Changed

• (Super tiny doc update) Mention to_polars by @​fzyzcjy in huggingface/datasets#7232
• [MINOR:TYPO] Update arrow_dataset.py by @​cakiki in huggingface/datasets#7236
• Missing video docs by @​lhoestq in huggingface/datasets#7251
• fix decord import by @​lhoestq in huggingface/datasets#7255
• fix ci for pyarrow 18 by @​lhoestq in huggingface/datasets#7257
• Retry all requests timeouts by @​lhoestq in huggingface/datasets#7256
• Always set non-null writer batch size by @​lhoestq in huggingface/datasets#7258
• Don't embed videos by @​lhoestq in huggingface/datasets#7259
• Allow video with disabeld decoding without decord by @​lhoestq in huggingface/datasets#7262
• Small addition to video docs by @​lhoestq in huggingface/datasets#7263
• fix docs relative links by @​lhoestq in huggingface/datasets#7264
• Disallow video push_to_hub by @​lhoestq in huggingface/datasets#7265

New Contributors

• @​fzyzcjy made their first contribution in huggingface/datasets#7232

Full Changelog: https://github.com/huggingface/datasets/compare/3.0.2...3.1.0

3.0.2

Main bug fixes

• fix unbatched arrow map for iterable datasets by @​alex-hh in huggingface/datasets#7204
• Support features in metadata configs by @​albertvillanova in huggingface/datasets#7182
• Preserve features in iterable dataset.filter by @​alex-hh in huggingface/datasets#7209

... (truncated)

Commits

• dfb52e2 Release: 3.1.0 (#7270)
• f8e3321 Disallow video push_to_hub (#7265)
• 46e4616 fix docs relative links (#7264)
• b08f762 Small addition to video docs (#7263)
• 1946182 Allow video with disabeld decoding without decord (#7262)
• f75f489 Don't embed videos (#7259)
• ff0149f Always set non-null writer batch size (#7258)
• 444ce83 Retry all requests timeouts (#7256)
• a9c610f fix ci for pyarrow 18 (#7257)
• 91e9313 fix decord import (#7255)
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)