Bump datasets from 1.15.1 to 2.10.0

[dependabot[bot]]

Bumps datasets from 1.15.1 to 2.10.0.

Release notes

Sourced from datasets's releases.

2.10.0

Important

• Avoid saving sparse ChunkedArrays in pyarrow tables by @​marioga in huggingface/datasets#5542
  • Big improvements on the speed of .flatten_indices() (x2) + save/load_from_disk (x100) on selected/shuffled datasets
• Skip dataset verifications by default by @​mariosasko in huggingface/datasets#5303
  • introduces multiple verification_mode you can pass to `load_dataset()):
  • the new default verification steps are much faster (no need to compute expensive checksums)

Datasets features

• Single TQDM bar in multi-proc map by @​mariosasko in huggingface/datasets#5455
  • No more stacked TQDM bars when calling .map() in multiprocessing
• Map-style Dataset to IterableDataset by @​lhoestq in huggingface/datasets#5410
  • introduces .to_iterable_dataset() to get a IterableDataset from a Dataset
  • see all the advantages of IterableDataset in the documentation about the differences between Dataset and IterableDataset
• Select columns of Dataset or DatasetDict by @​daskol in huggingface/datasets#5480
  • introduces .select_column() to return a dataset only containing the requested columns
• Added functionality: sort datasets by multiple keys by @​MichlF in huggingface/datasets#5502
  • introduces ds = ds.sort(['col_1', 'col_2'], reverse=[True, False])
• Add JAX device selection when formatting by @​alvarobartt in huggingface/datasets#5547
  • introduces ds = ds.with_format("jax", device=device)
• Reload features from Parquet metadata by @​MFreidank in huggingface/datasets#5516
• Speed up batched PyTorch DataLoader by @​lhoestq in huggingface/datasets#5512

Documentation

• Add section in tutorial for IterableDataset by @​stevhliu in huggingface/datasets#5485
  • https://huggingface.co/docs/datasets/main/en/access#iterabledataset
• Tutorial for creating a dataset by @​stevhliu in huggingface/datasets#5540
  • https://huggingface.co/docs/datasets/main/en/create_dataset
• Add JAX-formatting documentation by @​alvarobartt in huggingface/datasets#5535
  • https://huggingface.co/docs/datasets/main/en/use_with_jax

General improvements and bug fixes

• Pin sqlalchemy by @​lhoestq in huggingface/datasets#5476
• Update dataset card creation by @​stevhliu in huggingface/datasets#5470
• Add num_test_batches option by @​amyeroberts in huggingface/datasets#5471
• Tip for recomputing metadata by @​stevhliu in huggingface/datasets#5478
• Disable aiohttp requoting of redirection URL by @​albertvillanova in huggingface/datasets#5459
• [MINOR] Typo by @​cakiki in huggingface/datasets#5491
• Pin dill lower version by @​albertvillanova in huggingface/datasets#5489
• Improved error message for gated/private repos by @​osanseviero in huggingface/datasets#5497
• Update docs for nyu_depth_v2 dataset by @​awsaf49 in huggingface/datasets#5484
• don't zero copy timestamps by @​dwyatte in huggingface/datasets#5504
• Remove unused load_from_cache_file arg from Dataset.shard() docstring by @​polinaeterna in huggingface/datasets#5493
• Do not add index column by default when exporting to CSV by @​albertvillanova in huggingface/datasets#5490
• Fix bug when casting empty array to class labels by @​marioga in huggingface/datasets#5521
• Fix benchmarks CI - pin protobuf by @​lhoestq in huggingface/datasets#5527

... (truncated)

Commits

• cac733f Release: 2.10.0 (#5563)
• 1875c8a Ensure last tqdm update in map (#5560)
• 2c67b5f Fix map suffix_template (#5559)
• 21c86d5 Add JAX device selection when formatting (#5547)
• 3b2aba6 Added functionality: sort datasets by multiple keys (#5502)
• da31f6e Add filter desc (#5557)
• 699b029 Suggest scikit-learn instead of sklearn (#5551)
• c2c75df Make tiktoken tokenizers hashable (#5552)
• e453eea improved message error row formatting (#5553)
• 4a767f7 Use default audio resampling type (#5556)
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[dependabot[bot]]

Superseded by #136.